2013-10-31 18:25:53,092 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2013-10-31 18:25:53,111 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop
2013-10-31 18:25:53,111 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.FieldedPipesPlatformTest
2013-10-31 18:25:53,137 INFO hadoop.HadoopPlatform (HadoopPlatform.java:setUp(118)) - using cluster
2013-10-31 18:25:53,381 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 18:25:53,382 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 18:25:53,382 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 18:25:53,382 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 18:25:53,558 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 18:25:53,558 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 18:25:53,558 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 18:25:53,561 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 18:25:53,561 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 18:25:53,562 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 18:25:53,567 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 18:25:53,706 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:54,908 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name1 has been successfully formatted.
2013-10-31 18:25:54,911 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:54,999 INFO common.Storage (FSImage.java:format(1331)) - Storage directory build/test/data/dfs/name2 has been successfully formatted.
2013-10-31 18:25:55,044 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-namenode.properties, hadoop-metrics2.properties
2013-10-31 18:25:55,112 INFO util.GSet (BlocksMap.java:computeCapacity(338)) - VM type = 64-bit
2013-10-31 18:25:55,112 INFO util.GSet (BlocksMap.java:computeCapacity(339)) - 2% max memory = 14.49 MB
2013-10-31 18:25:55,112 INFO util.GSet (BlocksMap.java:computeCapacity(340)) - capacity = 2^21 = 2097152 entries
2013-10-31 18:25:55,112 INFO util.GSet (LightWeightGSet.java:<init>(79)) - recommended=2097152, actual=2097152
2013-10-31 18:25:55,116 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(482)) - fsOwner=hadoop
2013-10-31 18:25:55,116 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(486)) - supergroup=supergroup
2013-10-31 18:25:55,117 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(487)) - isPermissionEnabled=true
2013-10-31 18:25:55,117 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(532)) - dfs.block.invalidate.limit=100
2013-10-31 18:25:55,117 WARN namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(537)) - The dfs.support.append option is in your configuration, however append is not supported. This configuration option is no longer required to enable sync.
2013-10-31 18:25:55,117 INFO namenode.FSNamesystem (FSNamesystem.java:setConfigurationParameters(549)) - isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
2013-10-31 18:25:55,120 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(5306)) - Registered FSNamesystemStateMBean and NameNodeMXBean
2013-10-31 18:25:55,120 INFO namenode.NameNode (FSDirectory.java:<init>(84)) - Caching file names occuring more than 10 times
2013-10-31 18:25:55,124 INFO common.Storage (FSImage.java:loadFSImage(899)) - Number of files = 1
2013-10-31 18:25:55,125 INFO common.Storage (FSImage.java:loadFilesUnderConstruction(1435)) - Number of files under construction = 0
2013-10-31 18:25:55,125 INFO common.Storage (FSImage.java:loadFSImage(832)) - Image file of size 112 loaded in 0 seconds.
2013-10-31 18:25:55,125 INFO common.Storage (FSEditLog.java:loadFSEdits(901)) - Edits file build/test/data/dfs/name1/current/edits of size 4 edits # 0 loaded in 0 seconds.
2013-10-31 18:25:55,126 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:55,206 INFO common.Storage (FSImage.java:saveFSImage(1067)) - Image file of size 112 saved in 0 seconds.
2013-10-31 18:25:55,284 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2013-10-31 18:25:55,285 INFO namenode.FSNamesystem (FSNamesystem.java:initialize(397)) - Finished loading FSImage in 169 msecs
2013-10-31 18:25:55,305 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3816)) - Total number of blocks = 0
2013-10-31 18:25:55,305 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3817)) - Number of invalid blocks = 0
2013-10-31 18:25:55,306 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3818)) - Number of under-replicated blocks = 0
2013-10-31 18:25:55,307 INFO namenode.FSNamesystem (FSNamesystem.java:processMisReplicatedBlocks(3819)) - Number of over-replicated blocks = 0
2013-10-31 18:25:55,307 INFO hdfs.StateChange (FSNamesystem.java:leave(4783)) - STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 19 msec
2013-10-31 18:25:55,308 INFO hdfs.StateChange (FSNamesystem.java:leave(4789)) - STATE* Leaving safe mode after 0 secs.
2013-10-31 18:25:55,309 INFO hdfs.StateChange (FSNamesystem.java:leave(4798)) - STATE* Network topology has 0 racks and 0 datanodes
2013-10-31 18:25:55,309 INFO hdfs.StateChange (FSNamesystem.java:leave(4801)) - STATE* UnderReplicatedBlocks has 0 blocks
2013-10-31 18:25:55,315 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:25:55,315 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 18:25:55,316 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 18:25:55,316 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndFirstCycle(221)) - InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
2013-10-31 18:25:55,316 INFO namenode.FSNamesystem (QueueProcessingStatistics.java:logEndLastCycle(234)) - InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
2013-10-31 18:25:55,325 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:25:55,328 INFO namenode.NameNode (NameNode.java:initialize(301)) - Namenode up at: /127.0.0.1:34237
2013-10-31 18:25:55,365 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-10-31 18:25:55,414 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:25:55,423 INFO http.HttpServer (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:25:55,428 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:25:55,429 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44117 webServer.getConnectors()[0].getLocalPort() returned 44117
2013-10-31 18:25:55,430 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44117
2013-10-31 18:25:55,430 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:25:55,465 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/hdfs to /tmp/Jetty_localhost_44117_hdfs____nz2ce9/webapp
2013-10-31 18:25:55,810 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:44117
2013-10-31 18:25:55,811 INFO namenode.NameNode (NameNode.java:run(451)) - Web-server up at: localhost:44117
2013-10-31 18:25:55,811 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:25:55,811 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 34237: starting
2013-10-31 18:25:55,845 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 34237: starting
2013-10-31 18:25:55,844 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 34237: starting
2013-10-31 18:25:55,845 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 34237: starting
2013-10-31 18:25:55,845 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 34237: starting
2013-10-31 18:25:55,845 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 34237: starting
2013-10-31 18:25:55,995 INFO metrics.MetricsSaver (?:<init>(?)) - MetricsSaver GradleWorkerMain root:hdfs:///mnt/var/lib/hadoop/metrics/ period:60 instanceId:i-3e21d259 jobflow:j-3AAKWCJW7N40B
Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2
2013-10-31 18:25:56,033 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:25:56,034 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:25:56,073 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data1 is not formatted.
2013-10-31 18:25:56,073 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:02,550 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data2 is not formatted.
2013-10-31 18:26:02,551 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:02,702 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:02,712 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 34578
2013-10-31 18:26:02,713 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:02,717 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:02,718 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:02,719 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:02,719 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 35620 webServer.getConnectors()[0].getLocalPort() returned 35620
2013-10-31 18:26:02,719 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 35620
2013-10-31 18:26:02,719 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:02,725 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_35620_datanode____adqtyx/webapp
2013-10-31 18:26:02,905 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:35620
2013-10-31 18:26:02,909 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:02,910 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:34578, storageID=, infoPort=35620, ipcPort=60357)
2013-10-31 18:26:02,924 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:34578 storage DS-11064708-10.5.128.102-34578-1383243962924
2013-10-31 18:26:02,927 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:34578
2013-10-31 18:26:03,009 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-11064708-10.5.128.102-34578-1383243962924 is assigned to data-node 127.0.0.1:34578
2013-10-31 18:26:03,010 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:03,013 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:34578 0 blocks
2013-10-31 18:26:03,014 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:03,015 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:03,015 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data1/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data2/current'}
Starting DataNode 1 with dfs.data.dir: build/test/data/dfs/data/data3,build/test/data/dfs/data/data4
2013-10-31 18:26:03,017 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:03,019 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 60357: starting
2013-10-31 18:26:03,020 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 60357: starting
2013-10-31 18:26:03,020 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 60357: starting
2013-10-31 18:26:03,021 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:03,022 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 60357: starting
2013-10-31 18:26:03,023 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:03,024 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:03,025 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:03,032 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:34578, blocks: 0, processing time: 2 msecs
2013-10-31 18:26:03,033 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 5 msec to generate and 4 msecs for RPC and NN processing
2013-10-31 18:26:03,033 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:03,034 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:03,035 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:03,062 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data3 is not formatted.
2013-10-31 18:26:03,063 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:03,204 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data4 is not formatted.
2013-10-31 18:26:03,204 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:03,346 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:03,347 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:03,352 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 54365
2013-10-31 18:26:03,352 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:03,355 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:03,357 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:03,357 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:03,358 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44582 webServer.getConnectors()[0].getLocalPort() returned 44582
2013-10-31 18:26:03,358 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44582
2013-10-31 18:26:03,359 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:03,371 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_44582_datanode____rfmx1y/webapp
2013-10-31 18:26:03,558 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:44582
2013-10-31 18:26:03,561 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:03,561 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:54365, storageID=, infoPort=44582, ipcPort=48188)
2013-10-31 18:26:03,562 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:54365 storage DS-316833290-10.5.128.102-54365-1383243963561
2013-10-31 18:26:03,562 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:54365
2013-10-31 18:26:04,886 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-316833290-10.5.128.102-54365-1383243963561 is assigned to data-node 127.0.0.1:54365
2013-10-31 18:26:04,887 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:04,889 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:54365 0 blocks
2013-10-31 18:26:04,891 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
Starting DataNode 2 with dfs.data.dir: build/test/data/dfs/data/data5,build/test/data/dfs/data/data6
2013-10-31 18:26:04,891 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data3/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data4/current'}
2013-10-31 18:26:04,892 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:04,897 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:04,897 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 48188: starting
2013-10-31 18:26:04,899 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 48188: starting
2013-10-31 18:26:04,898 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:04,898 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 48188: starting
2013-10-31 18:26:04,897 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 48188: starting
2013-10-31 18:26:04,899 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:04,903 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:04,905 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:04,910 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:54365, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:04,911 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 5 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 18:26:04,912 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:04,913 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:04,913 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:04,946 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data5 is not formatted.
2013-10-31 18:26:04,946 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,195 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data6 is not formatted.
2013-10-31 18:26:05,196 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,337 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:05,338 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,340 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 59471
2013-10-31 18:26:05,340 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:05,342 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:05,343 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:05,343 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:05,343 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 57157 webServer.getConnectors()[0].getLocalPort() returned 57157
2013-10-31 18:26:05,343 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 57157
2013-10-31 18:26:05,344 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:05,350 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_57157_datanode____.3e2bqg/webapp
2013-10-31 18:26:05,556 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:57157
2013-10-31 18:26:05,559 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:05,559 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:59471, storageID=, infoPort=57157, ipcPort=33809)
2013-10-31 18:26:05,560 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:59471 storage DS-955759156-10.5.128.102-59471-1383243965559
2013-10-31 18:26:05,561 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:59471
2013-10-31 18:26:05,602 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-955759156-10.5.128.102-59471-1383243965559 is assigned to data-node 127.0.0.1:59471
2013-10-31 18:26:05,602 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:05,604 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:59471 0 blocks
2013-10-31 18:26:05,605 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:05,606 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
Starting DataNode 3 with dfs.data.dir: build/test/data/dfs/data/data7,build/test/data/dfs/data/data8
2013-10-31 18:26:05,606 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data5/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data6/current'}
2013-10-31 18:26:05,610 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:05,610 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 33809: starting
2013-10-31 18:26:05,610 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:05,611 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 33809: starting
2013-10-31 18:26:05,610 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 33809: starting
2013-10-31 18:26:05,610 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 33809: starting
2013-10-31 18:26:05,610 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-datanode.properties, hadoop-metrics2.properties
2013-10-31 18:26:05,614 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:05,614 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1565)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,614 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:59471, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:05,616 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 1 msec to generate and 2 msecs for RPC and NN processing
2013-10-31 18:26:05,616 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:05,621 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:05,622 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:05,636 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data7 is not formatted.
2013-10-31 18:26:05,636 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,741 INFO common.Storage (DataStorage.java:recoverTransitionRead(122)) - Storage directory build/test/data/dfs/data/data8 is not formatted.
2013-10-31 18:26:05,741 INFO common.Storage (DataStorage.java:recoverTransitionRead(123)) - Formatting ...
2013-10-31 18:26:05,844 INFO datanode.DataNode (FSDataset.java:registerMBean(2056)) - Registered FSDatasetStatusMBean
2013-10-31 18:26:05,845 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=DataNode,name=DataNodeInfo
javax.management.InstanceAlreadyExistsException: Hadoop:service=DataNode,name=DataNodeInfo
at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.hdfs.server.datanode.DataNode.registerMXBean(DataNode.java:531)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:402)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:301)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1627)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1566)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1541)
at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:420)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:283)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at cascading.platform.hadoop.HadoopPlatform.setUp(HadoopPlatform.java:132)
at cascading.PlatformTestCase.setUp(PlatformTestCase.java:181)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:295)
at cascading.platform.PlatformRunner.runChild(PlatformRunner.java:61)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:80)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:47)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:103)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
at org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:05,850 INFO datanode.DataNode (DataNode.java:startDataNode(423)) - Opened data transfer server at 37740
2013-10-31 18:26:05,850 INFO datanode.DataNode (DataXceiverServer.java:<init>(75)) - Balancing bandwith is 1048576 bytes/s
2013-10-31 18:26:05,853 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:05,855 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(132)) - dfs.webhdfs.enabled = false
2013-10-31 18:26:05,855 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:05,856 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 55697 webServer.getConnectors()[0].getLocalPort() returned 55697
2013-10-31 18:26:05,856 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 55697
2013-10-31 18:26:05,856 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:05,870 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/datanode to /tmp/Jetty_localhost_55697_datanode____xojhnf/webapp
2013-10-31 18:26:06,033 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:55697
2013-10-31 18:26:06,036 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:06,036 INFO datanode.DataNode (DataNode.java:startDataNode(519)) - dnRegistration = DatanodeRegistration(127.0.0.1:37740, storageID=, infoPort=55697, ipcPort=35555)
2013-10-31 18:26:06,038 INFO hdfs.StateChange (FSNamesystem.java:registerDatanode(2412)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:37740 storage DS-1799801127-10.5.128.102-37740-1383243966037
2013-10-31 18:26:06,039 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1:37740
2013-10-31 18:26:06,087 INFO datanode.DataNode (DataNode.java:register(733)) - New storage id DS-1799801127-10.5.128.102-37740-1383243966037 is assigned to data-node 127.0.0.1:37740
2013-10-31 18:26:06,087 INFO datanode.DataNode (FSDataset.java:getBlocksBeingWrittenInfo(721)) - Finished generating blocks being written report for 2 volumes in 0 seconds
2013-10-31 18:26:06,089 INFO hdfs.StateChange (NameNode.java:blocksBeingWrittenReport(1019)) - *BLOCK* NameNode.blocksBeingWrittenReport: from 127.0.0.1:37740 0 blocks
2013-10-31 18:26:06,090 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:26:06,091 INFO datanode.DataNode (DataNode.java:run(1494)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555)In DataNode.run, data = FSDataset{dirpath='/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data7/current,/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/data/dfs/data/data8/current'}
2013-10-31 18:26:06,091 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:26:06,094 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:06,095 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 35555: starting
2013-10-31 18:26:06,097 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 35555: starting
2013-10-31 18:26:06,097 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 35555: starting
2013-10-31 18:26:06,097 INFO datanode.DataNode (DataNode.java:offerService(924)) - using BLOCKREPORT_INTERVAL of 3600000msec Initial delay: 0msec
2013-10-31 18:26:06,094 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 35555: starting
2013-10-31 18:26:06,103 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:26:06,156 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:26:06,176 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37740, blocks: 0, processing time: 0 msecs
2013-10-31 18:26:06,178 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 0 blocks took 2 msec to generate and 73 msecs for RPC and NN processing
2013-10-31 18:26:06,178 INFO datanode.DataNode (DataNode.java:offerService(1054)) - Starting Periodic block scanner.
2013-10-31 18:26:06,180 INFO datanode.DataNode (FSDataset.java:getBlockReport(1704)) - Generated rough (lockless) block report in 0 ms
2013-10-31 18:26:06,180 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
Generating rack names for tasktrackers
Generating host names for tasktrackers
2013-10-31 18:26:06,228 WARN impl.MetricsSystemImpl (MetricsSystemImpl.java:init(137)) - Metrics system not started: Cannot locate configuration: tried hadoop-metrics2-jobtracker.properties, hadoop-metrics2.properties
2013-10-31 18:26:06,228 WARN util.MBeans (MBeans.java:register(59)) - Hadoop:service=JobTracker,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:151)
at com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:160)
at com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:173)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:930)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:285)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:114)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner$1.run(MiniMRCluster.java:112)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
at org.apache.hadoop.mapred.MiniMRCluster$JobTrackerRunner.run(MiniMRCluster.java:112)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:26:06,257 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 18:26:06,259 INFO mapred.JobTracker (JobTracker.java:initializeTaskMemoryRelatedConfig(5174)) - Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-10-31 18:26:06,259 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(377)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-10-31 18:26:06,259 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:26:06,260 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(140)) - Updating the current master key for generating delegation tokens
2013-10-31 18:26:06,261 INFO mapred.JobTracker (JobTracker.java:<init>(2279)) - Starting jobtracker with owner as hadoop
2013-10-31 18:26:06,265 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:06,266 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:06,283 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:06,283 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 49233 webServer.getConnectors()[0].getLocalPort() returned 49233
2013-10-31 18:26:06,283 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 49233
2013-10-31 18:26:06,284 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:06,296 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/job to /tmp/Jetty_localhost_49233_job____4x32wx/webapp
2013-10-31 18:26:06,461 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:49233
2013-10-31 18:26:06,463 INFO mapred.JobTracker (JobTracker.java:<init>(2347)) - JobTracker up at: 52140
2013-10-31 18:26:06,464 INFO mapred.JobTracker (JobTracker.java:<init>(2351)) - JobTracker webserver: 49233
2013-10-31 18:26:06,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=null
2013-10-31 18:26:06,473 INFO mapred.JobTracker (JobTracker.java:<init>(2405)) - Creating the system directory
2013-10-31 18:26:06,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:07,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:26:07,027 INFO mapred.JobTracker (JobTracker.java:<init>(2469)) - History server being initialized in embedded mode
2013-10-31 18:26:07,030 INFO mapred.JobHistoryServer (JobHistoryServer.java:start(196)) - Started job history server at: localhost:49233
2013-10-31 18:26:07,031 INFO mapred.JobTracker (JobTracker.java:<init>(2472)) - Job History Server web address: localhost:49233
2013-10-31 18:26:07,033 INFO mapred.CompletedJobStatusStore (CompletedJobStatusStore.java:<init>(111)) - Completed job store is inactive
2013-10-31 18:26:07,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:07,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info dst=null perm=hadoop:supergroup:rw-------
2013-10-31 18:26:07,074 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info. blk_-8976559195179578700_1001
2013-10-31 18:26:07,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:48573 dest: /127.0.0.1:34578
2013-10-31 18:26:07,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:41771 dest: /127.0.0.1:59471
2013-10-31 18:26:07,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8976559195179578700_1001 src: /127.0.0.1:45946 dest: /127.0.0.1:54365
2013-10-31 18:26:07,104 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45946, dest: /127.0.0.1:54365, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8976559195179578700_1001, duration: 2113178
2013-10-31 18:26:07,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41771, dest: /127.0.0.1:59471, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8976559195179578700_1001, duration: 3520525
2013-10-31 18:26:07,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,107 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48573, dest: /127.0.0.1:34578, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8976559195179578700_1001, duration: 5020401
2013-10-31 18:26:07,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8976559195179578700_1001 terminating
2013-10-31 18:26:07,107 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,111 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8976559195179578700_1001 size 4
2013-10-31 18:26:07,112 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info from client DFSClient_-1596270109
2013-10-31 18:26:07,112 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/jobtracker.info is closed by DFSClient_-1596270109
2013-10-31 18:26:07,117 INFO mapred.JobTracker (JobTracker.java:refreshHosts(4945)) - Refreshing hosts information
2013-10-31 18:26:07,132 INFO util.HostsFileReader (HostsFileReader.java:setIncludesFile(100)) - Setting the includes file to
2013-10-31 18:26:07,132 INFO util.HostsFileReader (HostsFileReader.java:setExcludesFile(105)) - Setting the excludes file to
2013-10-31 18:26:07,132 INFO util.HostsFileReader (HostsFileReader.java:refresh(76)) - Refreshing hosts (include/exclude) list
2013-10-31 18:26:07,132 INFO mapred.JobTracker (JobTracker.java:decommissionNodes(4989)) - Decommissioning 0 nodes
2013-10-31 18:26:07,133 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 52140: starting
2013-10-31 18:26:07,133 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 52140: starting
2013-10-31 18:26:07,134 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 52140: starting
2013-10-31 18:26:07,133 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 52140: starting
2013-10-31 18:26:07,133 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:07,135 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 8 on 52140: starting
2013-10-31 18:26:07,136 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 9 on 52140: starting
2013-10-31 18:26:07,133 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 52140: starting
2013-10-31 18:26:07,135 INFO mapred.JobTracker (JobTracker.java:offerService(2630)) - Starting RUNNING
2013-10-31 18:26:07,135 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 7 on 52140: starting
2013-10-31 18:26:07,135 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 6 on 52140: starting
2013-10-31 18:26:07,135 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 4 on 52140: starting
2013-10-31 18:26:07,135 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 5 on 52140: starting
2013-10-31 18:26:07,192 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 18:26:12,209 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:12,227 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:12,231 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:12,231 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0
2013-10-31 18:26:12,260 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(52)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2013-10-31 18:26:12,271 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:12,271 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:12,272 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 33516: starting
2013-10-31 18:26:12,273 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 33516: starting
2013-10-31 18:26:12,273 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 33516: starting
2013-10-31 18:26:12,274 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:33516
2013-10-31 18:26:12,274 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 33516: starting
2013-10-31 18:26:12,273 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 33516: starting
2013-10-31 18:26:12,274 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:26:12,286 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:26:12,295 INFO util.ProcessTree (ProcessTree.java:isSetsidSupported(63)) - setsid exited with exit code 0
2013-10-31 18:26:12,301 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@60516af2
2013-10-31 18:26:12,305 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:12,341 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:12,348 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:12,349 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 41705 webServer.getConnectors()[0].getLocalPort() returned 41705
2013-10-31 18:26:12,349 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 41705
2013-10-31 18:26:12,349 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:12,354 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_41705_task____la6d4t/webapp
2013-10-31 18:26:12,507 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:41705
2013-10-31 18:26:12,507 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:12,508 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 18:26:12,509 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,510 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,511 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,512 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,513 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,514 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,515 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,516 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,517 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,518 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,519 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,520 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,521 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,522 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,523 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,524 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,525 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,526 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,527 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,528 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,529 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,530 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,531 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,532 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,533 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,534 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,535 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,536 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,538 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330372309
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,540 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,541 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,542 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,543 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,544 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,545 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,546 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,547 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,548 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,549 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,550 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,553 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,554 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,555 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,556 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:12,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330372333
2013-10-31 18:26:15,539 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/10.5.128.102
2013-10-31 18:26:15,542 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:33516 to host 10.5.128.102
2013-10-31 18:26:17,515 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:17,517 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:17,519 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:17,520 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0
2013-10-31 18:26:19,137 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:19,139 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:19,139 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 42022: starting
2013-10-31 18:26:19,141 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 42022: starting
2013-10-31 18:26:19,142 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:42022
2013-10-31 18:26:19,139 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 42022: starting
2013-10-31 18:26:19,139 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 42022: starting
2013-10-31 18:26:19,142 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:26:19,142 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 42022: starting
2013-10-31 18:26:19,148 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@49b639f7
2013-10-31 18:26:19,148 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:26:19,150 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:19,178 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:19,179 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:19,179 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 44527 webServer.getConnectors()[0].getLocalPort() returned 44527
2013-10-31 18:26:19,180 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 44527
2013-10-31 18:26:19,180 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:19,184 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_44527_task____ku89nc/webapp
2013-10-31 18:26:19,336 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:44527
2013-10-31 18:26:19,337 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:19,337 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 18:26:19,339 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,340 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,341 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,342 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,343 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,344 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,345 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,346 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,347 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,348 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,349 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,350 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,351 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,354 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,355 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,356 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,357 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,358 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,359 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,360 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,361 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,362 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,363 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,364 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,366 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,367 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,368 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,369 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,370 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,371 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,372 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,373 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,374 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,376 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330379151
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,377 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,378 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,379 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,380 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,381 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,382 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,383 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,384 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,385 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,386 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,387 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,388 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,389 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,390 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,391 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,392 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,393 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,394 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,395 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,396 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,397 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,398 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,399 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,400 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,401 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:19,402 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330379171
2013-10-31 18:26:22,361 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:42022 to host 10.5.128.102
2013-10-31 18:26:24,344 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:24,346 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:24,347 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:24,348 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0
2013-10-31 18:26:24,363 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:24,365 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 48953: starting
2013-10-31 18:26:24,365 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 48953: starting
2013-10-31 18:26:24,366 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 48953: starting
2013-10-31 18:26:24,365 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:24,368 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:48953
2013-10-31 18:26:24,368 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 48953: starting
2013-10-31 18:26:24,367 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 48953: starting
2013-10-31 18:26:24,370 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:26:24,374 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4702a0c1
2013-10-31 18:26:24,374 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:26:24,376 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:24,398 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:24,399 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:24,399 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 59831 webServer.getConnectors()[0].getLocalPort() returned 59831
2013-10-31 18:26:24,399 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 59831
2013-10-31 18:26:24,399 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:24,404 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_59831_task____.sgbkvk/webapp
2013-10-31 18:26:24,555 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:59831
2013-10-31 18:26:24,555 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:24,556 INFO mapred.MiniMRCluster (MiniMRCluster.java:<init>(189)) - mapred.local.dir is /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 18:26:24,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,557 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,558 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,559 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,560 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,561 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,562 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,563 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,564 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,565 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,566 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,567 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,568 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,569 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,570 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,571 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,572 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,574 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,575 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,576 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,577 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,578 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,579 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,580 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,581 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,582 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,583 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,584 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,585 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,586 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,587 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,588 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,589 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,592 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,593 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,594 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,595 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,596 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,597 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,598 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,599 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,600 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,601 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,602 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,604 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,605 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,606 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,607 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,608 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,609 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330384376
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,610 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,611 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,614 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,615 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,616 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,617 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,618 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,619 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,620 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,621 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,622 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,623 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,624 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,625 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,626 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,628 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,630 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,631 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,633 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,634 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:24,635 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330384392
2013-10-31 18:26:27,574 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:48953 to host 10.5.128.102
2013-10-31 18:26:29,565 INFO http.HttpServer (HttpServer.java:addGlobalFilter(417)) - Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-10-31 18:26:29,567 INFO mapred.TaskLogsTruncater (TaskLogsTruncater.java:<init>(72)) - Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
2013-10-31 18:26:29,569 INFO mapred.TaskTracker (TaskTracker.java:initialize(727)) - Starting tasktracker with owner as hadoop
2013-10-31 18:26:29,570 INFO mapred.TaskTracker (TaskTracker.java:initialize(744)) - Good mapred local directories are: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0
2013-10-31 18:26:29,599 INFO ipc.Server (Server.java:run(329)) - Starting SocketReader
2013-10-31 18:26:29,600 INFO ipc.Server (Server.java:run(599)) - IPC Server Responder: starting
2013-10-31 18:26:29,600 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 0 on 58210: starting
2013-10-31 18:26:29,602 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 2 on 58210: starting
2013-10-31 18:26:29,601 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 1 on 58210: starting
2013-10-31 18:26:29,600 INFO ipc.Server (Server.java:run(435)) - IPC Server listener on 58210: starting
2013-10-31 18:26:29,603 INFO ipc.Server (Server.java:run(1363)) - IPC Server handler 3 on 58210: starting
2013-10-31 18:26:29,603 INFO mapred.TaskTracker (TaskTracker.java:initialize(826)) - TaskTracker up at: localhost/127.0.0.1:58210
2013-10-31 18:26:29,605 INFO mapred.TaskTracker (TaskTracker.java:initialize(829)) - Starting tracker tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:26:29,608 INFO mapred.TaskTracker (TaskTracker.java:initialize(860)) - Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@511a1546
2013-10-31 18:26:29,608 INFO mapred.TaskTracker (TaskTracker.java:run(996)) - Starting thread: Map-events fetcher for all reduce tasks on tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:26:29,610 WARN mapred.TaskTracker (TaskTracker.java:setTaskMemoryManagerEnabledFlag(4329)) - TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.
2013-10-31 18:26:29,635 INFO mapred.IndexCache (IndexCache.java:<init>(46)) - IndexCache created with max memory = 10485760
2013-10-31 18:26:29,636 INFO http.HttpServer (HttpServer.java:start(584)) - Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 0
2013-10-31 18:26:29,636 INFO http.HttpServer (HttpServer.java:start(589)) - listener.getLocalPort() returned 54694 webServer.getConnectors()[0].getLocalPort() returned 54694
2013-10-31 18:26:29,637 INFO http.HttpServer (HttpServer.java:start(622)) - Jetty bound to port 54694
2013-10-31 18:26:29,637 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2013-10-31 18:26:29,641 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/home/hadoop/hadoop-core.jar!/webapps/task to /tmp/Jetty_0_0_0_0_54694_task____.hu318w/webapp
2013-10-31 18:26:29,831 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@0.0.0.0:54694
2013-10-31 18:26:29,832 INFO mapred.TaskTracker (TaskTracker.java:<init>(1585)) - FILE_CACHE_SIZE for mapOutputServlet set to : 2000
2013-10-31 18:26:29,832 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,833 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,834 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,835 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,836 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,837 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,838 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,839 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0045 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,841 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,845 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,846 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,847 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,849 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,850 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,851 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,853 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,854 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,855 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,857 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0032 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0035 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0042 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0002 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,860 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0005 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,861 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0041 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0034 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0027 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0044 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,863 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0012 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0010 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0033 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,864 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330389610
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062304725_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,865 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,866 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0041 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,867 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0034 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0042 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,870 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,871 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062356814_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0039 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,873 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,874 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,875 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0032 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,876 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,877 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0033 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,878 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0043 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,880 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0034 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,881 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0031 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0023 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0040 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,882 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065542888_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0043 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0029 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031060104136_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0014 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0035 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0022 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,884 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065856455_0006 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0030 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0017 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0002 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,885 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031065414395_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0028 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0013 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063155788_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0020 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0021 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0019 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0009 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0027 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031064240330_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,887 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0015 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062512825_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0026 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063351698_0010 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,888 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0018 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0005 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031052949036_0024 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0036 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0012 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031061034324_0001 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0038 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031062845526_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031050733854_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,890 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0004 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0025 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031070257074_0003 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0007 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031063900591_0008 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031055442444_0011 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031044646992_0037 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031042929274_0031 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:29,891 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031180813424_0016 for user-log deletion with retainTimeStamp:1383330389628
2013-10-31 18:26:32,849 INFO mapred.JobTracker (JobTracker.java:addNewTracker(3214)) - Adding tracker tracker_10.5.128.102:localhost/127.0.0.1:58210 to host 10.5.128.102
2013-10-31 18:26:33,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,352 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt. blk_695637524992237905_1002
2013-10-31 18:26:33,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:46127 dest: /127.0.0.1:54365
2013-10-31 18:26:33,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:48757 dest: /127.0.0.1:34578
2013-10-31 18:26:33,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_695637524992237905_1002 src: /127.0.0.1:45846 dest: /127.0.0.1:37740
2013-10-31 18:26:33,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45846, dest: /127.0.0.1:37740, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 5913633
2013-10-31 18:26:33,373 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,375 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48757, dest: /127.0.0.1:34578, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 7519417
2013-10-31 18:26:33,376 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,378 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,379 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46127, dest: /127.0.0.1:54365, bytes: 1449, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 7843820
2013-10-31 18:26:33,379 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,380 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_695637524992237905_1002 terminating
2013-10-31 18:26:33,384 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_695637524992237905_1002 size 1449
2013-10-31 18:26:33,384 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt from client DFSClient_-1596270109
2013-10-31 18:26:33,385 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt is closed by DFSClient_-1596270109
2013-10-31 18:26:33,442 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:26:33,443 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:26:33,452 INFO property.AppProps (AppProps.java:getAppID(162)) - using app.id: 5A418A83440341CFB03287AC626F8D10
2013-10-31 18:26:33,580 INFO util.Version (Version.java:printBanner(78)) - Concurrent, Inc - Cascading 2.2.0
2013-10-31 18:26:33,584 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:26:33,585 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:26:33,585 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex"]
2013-10-31 18:26:33,586 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:26:33,586 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:26:33,587 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:26:33,588 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pesplatform/filtercomplex
2013-10-31 18:26:33,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:26:33,607 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:26:33,607 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:26:33,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:33,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:26:33,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,647 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar. blk_-8119916807805166670_1003
2013-10-31 18:26:33,649 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:41958 dest: /127.0.0.1:59471
2013-10-31 18:26:33,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:45850 dest: /127.0.0.1:37740
2013-10-31 18:26:33,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:48763 dest: /127.0.0.1:34578
2013-10-31 18:26:33,674 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48763, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8119916807805166670_1003, duration: 17148128
2013-10-31 18:26:33,675 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,676 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,679 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45850, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8119916807805166670_1003, duration: 19916120
2013-10-31 18:26:33,679 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41958, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 23111959
2013-10-31 18:26:33,683 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8119916807805166670_1003 terminating
2013-10-31 18:26:33,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:33,689 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar from client DFSClient_-1596270109
2013-10-31 18:26:33,689 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:26:33,697 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar. New replication is 10
2013-10-31 18:26:33,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=null
2013-10-31 18:26:33,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,713 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:26:33,732 WARN snappy.LoadSnappy (LoadSnappy.java:<clinit>(46)) - Snappy native library not loaded
2013-10-31 18:26:33,737 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:26:33,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:26:33,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:33,759 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split. New replication is 10
2013-10-31 18:26:34,322 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-8119916807805166670_1003 to datanode(s) 127.0.0.1:54365
2013-10-31 18:26:35,625 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-8119916807805166670_1003 to 127.0.0.1:54365
2013-10-31 18:26:35,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8119916807805166670_1003 src: /127.0.0.1:46135 dest: /127.0.0.1:54365
2013-10-31 18:26:35,635 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-8119916807805166670_1003 to /127.0.0.1:54365
2013-10-31 18:26:35,638 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-8119916807805166670_1003 src: /127.0.0.1:46135 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:26:35,643 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8119916807805166670_1003 size 238055
2013-10-31 18:26:41,640 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated DatanodeProtocol.sendHeartbeat 50 raw values into 38 aggregated values, total 38
2013-10-31 18:26:42,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=null
2013-10-31 18:26:42,938 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split. blk_-7169271713417131077_1004
2013-10-31 18:26:42,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:46164 dest: /127.0.0.1:54365
2013-10-31 18:26:42,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:48794 dest: /127.0.0.1:34578
2013-10-31 18:26:42,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:45883 dest: /127.0.0.1:37740
2013-10-31 18:26:42,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7169271713417131077_1004 src: /127.0.0.1:41993 dest: /127.0.0.1:59471
2013-10-31 18:26:42,954 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:41993, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7169271713417131077_1004, duration: 4273352
2013-10-31 18:26:42,954 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,956 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,958 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45883, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7169271713417131077_1004, duration: 6950504
2013-10-31 18:26:42,959 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,962 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48794, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7169271713417131077_1004, duration: 11021296
2013-10-31 18:26:42,963 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,968 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46164, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7169271713417131077_1004, duration: 17294745
2013-10-31 18:26:42,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7169271713417131077_1004 terminating
2013-10-31 18:26:42,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7169271713417131077_1004 size 1403
2013-10-31 18:26:42,975 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split from client DFSClient_-1596270109
2013-10-31 18:26:42,976 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split is closed by DFSClient_-1596270109
2013-10-31 18:26:42,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:42,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,003 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo. blk_-818079583544537979_1005
2013-10-31 18:26:43,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:48797 dest: /127.0.0.1:34578
2013-10-31 18:26:43,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:45886 dest: /127.0.0.1:37740
2013-10-31 18:26:43,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-818079583544537979_1005 src: /127.0.0.1:46170 dest: /127.0.0.1:54365
2013-10-31 18:26:43,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46170, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-818079583544537979_1005, duration: 3040329
2013-10-31 18:26:43,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,015 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45886, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-818079583544537979_1005, duration: 5192398
2013-10-31 18:26:43,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,021 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48797, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-818079583544537979_1005, duration: 8001406
2013-10-31 18:26:43,022 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-818079583544537979_1005 terminating
2013-10-31 18:26:43,025 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,025 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:26:43,026 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:26:43,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-818079583544537979_1005 size 156
2013-10-31 18:26:43,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,170 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml. blk_3898509533205014241_1006
2013-10-31 18:26:43,171 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:45889 dest: /127.0.0.1:37740
2013-10-31 18:26:43,173 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:48802 dest: /127.0.0.1:34578
2013-10-31 18:26:43,174 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3898509533205014241_1006 src: /127.0.0.1:46174 dest: /127.0.0.1:54365
2013-10-31 18:26:43,178 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46174, dest: /127.0.0.1:54365, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3898509533205014241_1006, duration: 3293474
2013-10-31 18:26:43,178 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,180 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,180 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48802, dest: /127.0.0.1:34578, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 4591751
2013-10-31 18:26:43,180 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,182 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45889, dest: /127.0.0.1:37740, bytes: 28656, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 6385818
2013-10-31 18:26:43,182 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,182 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3898509533205014241_1006 terminating
2013-10-31 18:26:43,185 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3898509533205014241_1006 size 28656
2013-10-31 18:26:43,185 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml from client DFSClient_-1596270109
2013-10-31 18:26:43,186 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:26:43,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=null
2013-10-31 18:26:43,211 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48805, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 354255
2013-10-31 18:26:43,231 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0001: nMaps=4 nReduces=1 max=-1
2013-10-31 18:26:43,233 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0001 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:26:43,234 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0001 RESULT=SUCCESS
2013-10-31 18:26:43,235 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0001
2013-10-31 18:26:43,235 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0001
2013-10-31 18:26:43,237 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0001
2013-10-31 18:26:43,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,321 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml. blk_-1869663385596486972_1008
2013-10-31 18:26:43,323 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:42005 dest: /127.0.0.1:59471
2013-10-31 18:26:43,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:46180 dest: /127.0.0.1:54365
2013-10-31 18:26:43,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1869663385596486972_1008 src: /127.0.0.1:48810 dest: /127.0.0.1:34578
2013-10-31 18:26:43,330 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48810, dest: /127.0.0.1:34578, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1869663385596486972_1008, duration: 2806644
2013-10-31 18:26:43,331 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,332 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46180, dest: /127.0.0.1:54365, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1869663385596486972_1008, duration: 3823257
2013-10-31 18:26:43,332 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,333 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,333 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42005, dest: /127.0.0.1:59471, bytes: 28721, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1869663385596486972_1008, duration: 4834412
2013-10-31 18:26:43,333 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,333 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1869663385596486972_1008 terminating
2013-10-31 18:26:43,335 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml from client DFSClient_-1955967223
2013-10-31 18:26:43,335 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_conf.xml is closed by DFSClient_-1955967223
2013-10-31 18:26:43,335 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1869663385596486972_1008 size 28721
2013-10-31 18:26:43,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:26:43,353 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken. blk_-4029352565037357501_1009
2013-10-31 18:26:43,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:46182 dest: /127.0.0.1:54365
2013-10-31 18:26:43,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:42009 dest: /127.0.0.1:59471
2013-10-31 18:26:43,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4029352565037357501_1009 src: /127.0.0.1:48813 dest: /127.0.0.1:34578
2013-10-31 18:26:43,358 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48813, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 1395210
2013-10-31 18:26:43,359 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,359 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42009, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 2195975
2013-10-31 18:26:43,359 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,360 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46182, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4029352565037357501_1009, duration: 3126781
2013-10-31 18:26:43,361 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,361 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4029352565037357501_1009 terminating
2013-10-31 18:26:43,362 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,362 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken from client DFSClient_-1596270109
2013-10-31 18:26:43,363 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:26:43,363 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4029352565037357501_1009 size 116
2013-10-31 18:26:43,367 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken
2013-10-31 18:26:43,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.splitmetainfo dst=null perm=null
2013-10-31 18:26:43,371 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45902, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-818079583544537979_1005, duration: 349867
2013-10-31 18:26:43,382 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0001 = 1449. Number of splits = 4
2013-10-31 18:26:43,382 INFO net.NetworkTopology (NetworkTopology.java:add(338)) - Adding a new node: /default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,383 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,384 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,385 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0001_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:26:43,386 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0001 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:26:43,388 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0001 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:26:43,433 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0001_m_000005_0' to tip task_20131031182606197_0001_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:43,442 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:26:43,446 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000005_0 which needs 1 slots
2013-10-31 18:26:43,447 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000005_0 which needs 1 slots
2013-10-31 18:26:43,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken dst=null perm=null
2013-10-31 18:26:43,466 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42012, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 577340
2013-10-31 18:26:43,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=null
2013-10-31 18:26:43,490 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45905, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1061544104, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 791685
2013-10-31 18:26:43,533 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:43,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=null
2013-10-31 18:26:43,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46189, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1061544104, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8119916807805166670_1003, duration: 2951356
2013-10-31 18:26:43,723 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1893423327
2013-10-31 18:26:43,724 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1893423327 spawned.
2013-10-31 18:26:43,726 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000005_0/taskjvm.sh
2013-10-31 18:26:45,581 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1893423327 given task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:46,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:26:49,010 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000005_0 0.0% setup
2013-10-31 18:26:49,014 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000005_0 is done.
2013-10-31 18:26:49,015 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000005_0 was -1
2013-10-31 18:26:49,016 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:49,460 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000005_0' has completed task_20131031182606197_0001_m_000005 successfully.
2013-10-31 18:26:49,472 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000000_0' to tip task_20131031182606197_0001_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:49,475 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000000
2013-10-31 18:26:49,478 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:26:49,479 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000000_0 which needs 1 slots
2013-10-31 18:26:49,479 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000000_0 which needs 1 slots
2013-10-31 18:26:49,521 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_-1261202210
2013-10-31 18:26:49,523 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_-1261202210 spawned.
2013-10-31 18:26:49,527 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000000_0/taskjvm.sh
2013-10-31 18:26:50,440 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_-1261202210 given task: attempt_20131031182606197_0001_m_000000_0
2013-10-31 18:26:50,882 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000001_0' to tip task_20131031182606197_0001_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:26:50,884 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000001
2013-10-31 18:26:50,887 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:26:50,887 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000001_0 which needs 1 slots
2013-10-31 18:26:50,887 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000001_0 which needs 1 slots
2013-10-31 18:26:50,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken dst=null perm=null
2013-10-31 18:26:50,902 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48874, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 230276
2013-10-31 18:26:50,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=null
2013-10-31 18:26:50,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45964, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-698521807, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3898509533205014241_1006, duration: 330915
2013-10-31 18:26:50,943 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:50,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=null
2013-10-31 18:26:50,967 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42074, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-698521807, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 2086974
2013-10-31 18:26:50,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=null
2013-10-31 18:26:50,981 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46249, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7169271713417131077_1004, duration: 277560
2013-10-31 18:26:51,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:26:51,022 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46250, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 200338
2013-10-31 18:26:51,052 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1448684247
2013-10-31 18:26:51,053 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1448684247 spawned.
2013-10-31 18:26:51,055 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000001_0/taskjvm.sh
2013-10-31 18:26:51,609 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000002_0' to tip task_20131031182606197_0001_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:26:51,609 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000002
2013-10-31 18:26:51,610 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:26:51,610 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0001_m_000003_0' to tip task_20131031182606197_0001_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:26:51,610 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000002_0 which needs 1 slots
2013-10-31 18:26:51,611 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000002_0 which needs 1 slots
2013-10-31 18:26:51,611 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0001_m_000003
2013-10-31 18:26:51,614 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:26:51,614 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000003_0 which needs 1 slots
2013-10-31 18:26:51,615 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000003_0 which needs 1 slots
2013-10-31 18:26:51,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken dst=null perm=null
2013-10-31 18:26:51,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001/jobToken dst=null perm=null
2013-10-31 18:26:51,643 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42077, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4029352565037357501_1009, duration: 222951
2013-10-31 18:26:51,645 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4029352565037357501_1009, duration: 209377
2013-10-31 18:26:51,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=null
2013-10-31 18:26:51,658 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48885, bytes: 28880, op: HDFS_READ, cliID: DFSClient_1803231535, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3898509533205014241_1006, duration: 775168
2013-10-31 18:26:51,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.xml dst=null perm=null
2013-10-31 18:26:51,665 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46259, bytes: 28880, op: HDFS_READ, cliID: DFSClient_-1906851011, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3898509533205014241_1006, duration: 302263
2013-10-31 18:26:51,680 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:51,690 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:26:51,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=null
2013-10-31 18:26:51,702 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42086, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1803231535, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8119916807805166670_1003, duration: 1350790
2013-10-31 18:26:51,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.jar dst=null perm=null
2013-10-31 18:26:51,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1906851011, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8119916807805166670_1003, duration: 1413710
2013-10-31 18:26:51,780 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1010257680
2013-10-31 18:26:51,781 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1010257680 spawned.
2013-10-31 18:26:51,782 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000003_0/taskjvm.sh
2013-10-31 18:26:51,786 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_m_1027368877
2013-10-31 18:26:51,786 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_m_1027368877 spawned.
2013-10-31 18:26:51,789 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_m_000002_0/taskjvm.sh
2013-10-31 18:26:52,441 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1448684247 given task: attempt_20131031182606197_0001_m_000001_0
2013-10-31 18:26:52,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=null
2013-10-31 18:26:52,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:45991, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7169271713417131077_1004, duration: 263821
2013-10-31 18:26:52,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:26:53,274 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48904, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 289487
2013-10-31 18:26:53,866 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1010257680 given task: attempt_20131031182606197_0001_m_000003_0
2013-10-31 18:26:53,911 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:26:53,914 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000000_0 is done.
2013-10-31 18:26:53,914 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000000_0 was 121
2013-10-31 18:26:53,914 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:54,057 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_1027368877 given task: attempt_20131031182606197_0001_m_000002_0
2013-10-31 18:26:54,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=null
2013-10-31 18:26:54,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:48914, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7169271713417131077_1004, duration: 200036
2013-10-31 18:26:54,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:26:54,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46286, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 693322
2013-10-31 18:26:54,479 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:54,479 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0001_m_000005_0
2013-10-31 18:26:54,479 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0001_m_000005_0 not found in cache
2013-10-31 18:26:54,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001/job.split dst=null perm=null
2013-10-31 18:26:54,572 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42114, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7169271713417131077_1004, duration: 275702
2013-10-31 18:26:54,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:26:54,611 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46007, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0001_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 287584
2013-10-31 18:26:55,490 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000000_0' has completed task_20131031182606197_0001_m_000000 successfully.
2013-10-31 18:26:55,514 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0001_r_000000_0' to tip task_20131031182606197_0001_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:26:55,518 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:26:55,519 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_r_000000_0 which needs 1 slots
2013-10-31 18:26:55,519 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_r_000000_0 which needs 1 slots
2013-10-31 18:26:55,558 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0001_r_1893423327
2013-10-31 18:26:55,558 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0001_r_1893423327 spawned.
2013-10-31 18:26:55,562 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0001/attempt_20131031182606197_0001_r_000000_0/taskjvm.sh
2013-10-31 18:26:55,861 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:26:55,868 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000001_0 is done.
2013-10-31 18:26:55,868 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000001_0 was 325
2013-10-31 18:26:55,870 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:55,999 INFO metrics.MetricsUtil (?:emrClusterStarted(?)) - instance controller state completed
2013-10-31 18:26:56,017 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:26:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,077 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,088 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,094 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,100 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,106 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:26:56,107 INFO metrics.MetricsSaver (?:flush(?)) - Discard 42 records
2013-10-31 18:26:56,890 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000001_0' has completed task_20131031182606197_0001_m_000001 successfully.
2013-10-31 18:26:57,281 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:26:57,284 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000003_0 is done.
2013-10-31 18:26:57,284 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000003_0 was 228
2013-10-31 18:26:57,285 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:57,338 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_r_1893423327 given task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:26:57,498 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:26:57,501 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000002_0 is done.
2013-10-31 18:26:57,501 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000002_0 was 120
2013-10-31 18:26:57,502 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:26:57,616 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000002_0' has completed task_20131031182606197_0001_m_000002 successfully.
2013-10-31 18:26:57,619 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000003_0' has completed task_20131031182606197_0001_m_000003 successfully.
2013-10-31 18:27:03,118 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43057, bytes: 121, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000000_0, duration: 36105979
2013-10-31 18:27:03,147 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38361, bytes: 325, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000001_0, duration: 12291867
2013-10-31 18:27:03,169 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40383, bytes: 120, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000002_0, duration: 15316408
2013-10-31 18:27:03,190 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48018, bytes: 228, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0001_m_000003_0, duration: 13720597
2013-10-31 18:27:03,856 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:03,888 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:03,946 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:04,154 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 60 Total time for transactions(ms): 6Number of transactions batched in Syncs: 0 Number of syncs: 31 SyncTimes(ms): 9576 885
2013-10-31 18:27:04,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:04,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:04,180 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000. blk_-3193214271390058748_1010
2013-10-31 18:27:04,203 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:46360 dest: /127.0.0.1:54365
2013-10-31 18:27:04,204 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:48990 dest: /127.0.0.1:34578
2013-10-31 18:27:04,205 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3193214271390058748_1010 src: /127.0.0.1:46079 dest: /127.0.0.1:37740
2013-10-31 18:27:04,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46079, dest: /127.0.0.1:37740, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3193214271390058748_1010, duration: 4631463
2013-10-31 18:27:04,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48990, dest: /127.0.0.1:34578, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3193214271390058748_1010, duration: 10487716
2013-10-31 18:27:04,224 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,225 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46360, dest: /127.0.0.1:54365, bytes: 7, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0001_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3193214271390058748_1010, duration: 14443367
2013-10-31 18:27:04,225 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,226 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3193214271390058748_1010 terminating
2013-10-31 18:27:04,228 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:04,228 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:04,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3193214271390058748_1010 size 7
2013-10-31 18:27:04,267 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0001_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:27:04,267 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:04,532 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0001_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:27:04,536 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:05,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0 dst=null perm=null
2013-10-31 18:27:05,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:05,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:05,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary/_attempt_20131031182606197_0001_r_000000_0 dst=null perm=null
2013-10-31 18:27:06,890 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:06,892 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:06,894 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_r_000000_0 is done.
2013-10-31 18:27:06,894 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_r_000000_0 was -1
2013-10-31 18:27:06,894 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:07,539 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_r_000000_0' has completed task_20131031182606197_0001_r_000000 successfully.
2013-10-31 18:27:07,544 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0001_m_000004_0' to tip task_20131031182606197_0001_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:27:07,546 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0001_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:27:07,546 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0001_m_000004_0 which needs 1 slots
2013-10-31 18:27:07,546 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0001_m_000004_0 which needs 1 slots
2013-10-31 18:27:07,568 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0001/attempt_20131031182606197_0001_m_000004_0. Attempting to reuse: jvm_20131031182606197_0001_m_-1261202210
2013-10-31 18:27:07,968 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0001_m_-1261202210 given task: attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,100 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000004_0 0.0%
2013-10-31 18:27:08,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary dst=null perm=null
2013-10-31 18:27:08,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:08,120 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS from client DFSClient_attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,120 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0001_m_000004_0
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8119916807805166670 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:08,127 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7169271713417131077 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-818079583544537979 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:08,128 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3898509533205014241 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:08,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0001 dst=null perm=null
2013-10-31 18:27:10,328 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-7169271713417131077_1004 blk_-8119916807805166670_1003
2013-10-31 18:27:10,329 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:10,923 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data3/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:10,925 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data4/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:10,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data3/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:10,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data4/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:10,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data4/current/blk_-7169271713417131077
2013-10-31 18:27:10,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data3/current/blk_-8119916807805166670
2013-10-31 18:27:10,927 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data4/current/blk_3898509533205014241
2013-10-31 18:27:10,928 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data3/current/blk_-818079583544537979
2013-10-31 18:27:11,046 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0001_m_000004_0 0.0% cleanup
2013-10-31 18:27:11,049 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0001_m_000004_0 is done.
2013-10-31 18:27:11,049 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0001_m_000004_0 was -1
2013-10-31 18:27:11,049 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:11,635 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data6/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:11,636 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data5/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:11,637 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data5/current/blk_-7169271713417131077
2013-10-31 18:27:11,637 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data6/current/blk_-8119916807805166670
2013-10-31 18:27:12,546 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:12,547 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0001_r_000000_0
2013-10-31 18:27:13,329 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:13,330 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_3898509533205014241_1006 blk_-7169271713417131077_1004 blk_-8119916807805166670_1003 blk_-818079583544537979_1005
2013-10-31 18:27:13,555 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0001_m_000004_0' has completed task_20131031182606197_0001_m_000004 successfully.
2013-10-31 18:27:13,558 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0001 has completed successfully.
2013-10-31 18:27:13,563 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0001,submitTime=1383244003200,launchTime=1383244003387,firstMapTaskLaunchTime=1383244009472,firstReduceTaskLaunchTime=1383244015505,firstJobSetupTaskLaunchTime=1383244003398,firstJobCleanupTaskLaunchTime=1383244027543,finishTime=1383244033558,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[0DBC7A13253E46468B989E48B430E8C4/152B993DA7C64F6F95F45A3241E871E7] test/(1/1) ...pesplatform/filtercomplex
2013-10-31 18:27:13,570 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F. blk_-3853691654878838440_1011
2013-10-31 18:27:13,572 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:42253 dest: /127.0.0.1:59471
2013-10-31 18:27:13,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:46428 dest: /127.0.0.1:54365
2013-10-31 18:27:13,579 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3853691654878838440_1011 src: /127.0.0.1:49058 dest: /127.0.0.1:34578
2013-10-31 18:27:13,586 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49058, dest: /127.0.0.1:34578, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3853691654878838440_1011, duration: 2776107
2013-10-31 18:27:13,586 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,588 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46428, dest: /127.0.0.1:54365, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3853691654878838440_1011, duration: 4086242
2013-10-31 18:27:13,588 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,589 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42253, dest: /127.0.0.1:59471, bytes: 28289, op: HDFS_WRITE, cliID: DFSClient_-1955967223, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3853691654878838440_1011, duration: 5323239
2013-10-31 18:27:13,590 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3853691654878838440_1011 terminating
2013-10-31 18:27:13,592 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,593 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F from client DFSClient_-1955967223
2013-10-31 18:27:13,593 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_logs/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F is closed by DFSClient_-1955967223
2013-10-31 18:27:13,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3853691654878838440_1011 size 28289
2013-10-31 18:27:13,605 INFO mapred.JobHistory (JobHistory.java:maybeMakeSubdirectory(403)) - Creating DONE subfolder at file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,607 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0001_1383244003200_hadoop_%5B0DBC7A13253E46468B989E48B430E8C4%2F152B993DA7C64F6F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,607 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000000_0'
2013-10-31 18:27:13,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000004_0'
2013-10-31 18:27:13,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000005_0'
2013-10-31 18:27:13,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_r_000000_0'
2013-10-31 18:27:13,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:13,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:13,611 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4029352565037357501 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:13,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0001 dst=null perm=null
2013-10-31 18:27:13,617 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0001_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:27:13,624 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/_temporary
2013-10-31 18:27:13,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex dst=null perm=null
2013-10-31 18:27:13,642 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:27:13,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000 dst=null perm=null
2013-10-31 18:27:13,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000 dst=null perm=null
2013-10-31 18:27:13,661 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46148, bytes: 11, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3193214271390058748_1010, duration: 436022
2013-10-31 18:27:13,661 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filtercomplex
2013-10-31 18:27:13,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex dst=null perm=null
2013-10-31 18:27:13,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filtercomplex/part-00000 dst=null perm=null
2013-10-31 18:27:13,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46432, bytes: 11, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3193214271390058748_1010, duration: 442943
2013-10-31 18:27:13,687 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:27:13,688 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:27:13,714 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:27:13,714 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:27:13,714 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextDelimited[['ip', 'count1', 'count2', 'count3', 'count4']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain"]
2013-10-31 18:27:13,715 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:27:13,715 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:27:13,715 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:27:13,715 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pipesplatform/simplechain
2013-10-31 18:27:13,720 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:27:13,720 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:27:13,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:13,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:27:13,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,736 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar. blk_-2141313976185548712_1012
2013-10-31 18:27:13,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:49062 dest: /127.0.0.1:34578
2013-10-31 18:27:13,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:46151 dest: /127.0.0.1:37740
2013-10-31 18:27:13,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:46435 dest: /127.0.0.1:54365
2013-10-31 18:27:13,748 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46435, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 7166426
2013-10-31 18:27:13,748 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,749 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46151, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2141313976185548712_1012, duration: 7904182
2013-10-31 18:27:13,749 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,750 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49062, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2141313976185548712_1012, duration: 8188079
2013-10-31 18:27:13,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2141313976185548712_1012 terminating
2013-10-31 18:27:13,753 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar from client DFSClient_-1596270109
2013-10-31 18:27:13,753 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:27:13,754 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,754 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:13,758 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar. New replication is 10
2013-10-31 18:27:13,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=null
2013-10-31 18:27:13,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,769 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:27:13,776 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:27:13,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:27:13,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:13,793 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split. New replication is 10
2013-10-31 18:27:14,919 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000001_0'
2013-10-31 18:27:15,047 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data1/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:15,048 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data2/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:15,048 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data1/current/blk_-8119916807805166670
2013-10-31 18:27:15,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data2/current/blk_-7169271713417131077
2013-10-31 18:27:15,048 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data1/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:15,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data2/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:15,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data1/current/blk_-818079583544537979
2013-10-31 18:27:15,050 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data2/current/blk_3898509533205014241
2013-10-31 18:27:15,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8119916807805166670_1003 file build/test/data/dfs/data/data8/current/blk_-8119916807805166670 for deletion
2013-10-31 18:27:15,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7169271713417131077_1004 file build/test/data/dfs/data/data7/current/blk_-7169271713417131077 for deletion
2013-10-31 18:27:15,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-818079583544537979_1005 file build/test/data/dfs/data/data8/current/blk_-818079583544537979 for deletion
2013-10-31 18:27:15,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7169271713417131077_1004 at file build/test/data/dfs/data/data7/current/blk_-7169271713417131077
2013-10-31 18:27:15,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8119916807805166670_1003 at file build/test/data/dfs/data/data8/current/blk_-8119916807805166670
2013-10-31 18:27:15,125 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3898509533205014241_1006 file build/test/data/dfs/data/data7/current/blk_3898509533205014241 for deletion
2013-10-31 18:27:15,125 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-818079583544537979_1005 at file build/test/data/dfs/data/data8/current/blk_-818079583544537979
2013-10-31 18:27:15,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3898509533205014241_1006 at file build/test/data/dfs/data/data7/current/blk_3898509533205014241
2013-10-31 18:27:15,646 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000002_0'
2013-10-31 18:27:15,647 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0001_m_000003_0'
2013-10-31 18:27:16,330 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2141313976185548712_1012 to datanode(s) 127.0.0.1:59471
2013-10-31 18:27:16,331 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-4029352565037357501_1009
2013-10-31 18:27:16,331 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4029352565037357501_1009
2013-10-31 18:27:16,925 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2141313976185548712_1012 to 127.0.0.1:59471
2013-10-31 18:27:16,926 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data4/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:16,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:42268 dest: /127.0.0.1:59471
2013-10-31 18:27:16,928 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2141313976185548712_1012 to /127.0.0.1:59471
2013-10-31 18:27:18,048 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data2/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:18,609 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:18,610 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0001_m_000004_0 not found in cache
2013-10-31 18:27:18,612 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330438612
2013-10-31 18:27:19,085 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_-1261202210 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,100 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15591 with signal TERM. Exit code 0
2013-10-31 18:27:19,192 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1893423327 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,203 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15531 with signal TERM. Exit code 0
2013-10-31 18:27:19,267 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data2/current/blk_-4029352565037357501
2013-10-31 18:27:19,284 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,285 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,285 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:19,285 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_-1261202210 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:27:19,332 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2141313976185548712_1012 to datanode(s) 127.0.0.1:59471
2013-10-31 18:27:19,332 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4029352565037357501_1009
2013-10-31 18:27:19,360 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,360 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,361 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:19,361 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1893423327 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:19,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data4/current/blk_-4029352565037357501
2013-10-31 18:27:19,368 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2141313976185548712_1012 src: /127.0.0.1:42268 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:27:19,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2141313976185548712_1012 size 238055
2013-10-31 18:27:19,497 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_r_1893423327 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:19,509 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15874 with signal TERM. Exit code 0
2013-10-31 18:27:19,681 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:19,681 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:19,681 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:19,682 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_r_1893423327 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:19,920 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:19,921 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330439921
2013-10-31 18:27:19,926 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2141313976185548712_1012 to 127.0.0.1:59471
2013-10-31 18:27:19,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2141313976185548712_1012 src: /127.0.0.1:42287 dest: /127.0.0.1:59471
2013-10-31 18:27:19,929 INFO datanode.DataNode (DataXceiver.java:writeBlock(425)) - writeBlock blk_-2141313976185548712_1012 received exception org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException: Block blk_-2141313976185548712_1012 is valid, and cannot be written to.
2013-10-31 18:27:19,929 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2141313976185548712_1012 to /127.0.0.1:59471
2013-10-31 18:27:19,929 ERROR datanode.DataNode (DataXceiver.java:run(136)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):DataXceiver
org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException: Block blk_-2141313976185548712_1012 is valid, and cannot be written to.
at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:1396)
at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:99)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:304)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:112)
at java.lang.Thread.run(Thread.java:724)
2013-10-31 18:27:20,459 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1448684247 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:20,472 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15664 with signal TERM. Exit code 0
2013-10-31 18:27:20,637 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4029352565037357501_1009 file build/test/data/dfs/data/data5/current/blk_-4029352565037357501 for deletion
2013-10-31 18:27:20,638 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4029352565037357501_1009 at file build/test/data/dfs/data/data5/current/blk_-4029352565037357501
2013-10-31 18:27:20,647 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:20,648 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330440647
2013-10-31 18:27:20,648 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0001
2013-10-31 18:27:20,649 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0001 for user-log deletion with retainTimeStamp:1383330440649
2013-10-31 18:27:20,672 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:20,672 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:20,672 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:20,672 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1448684247 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:21,850 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1010257680 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:21,865 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15751 with signal TERM. Exit code 0
2013-10-31 18:27:22,070 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:22,070 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:22,070 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0001_m_1027368877 since job job_20131031182606197_0001 is dead
2013-10-31 18:27:22,070 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:22,072 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1010257680 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:22,085 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group15786 with signal TERM. Exit code 0
2013-10-31 18:27:22,299 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:27:22,300 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:27:22,300 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:27:22,300 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0001_m_1027368877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:27:23,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=null
2013-10-31 18:27:23,096 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split. blk_7633157263478609076_1013
2013-10-31 18:27:23,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:42299 dest: /127.0.0.1:59471
2013-10-31 18:27:23,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:46474 dest: /127.0.0.1:54365
2013-10-31 18:27:23,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:49104 dest: /127.0.0.1:34578
2013-10-31 18:27:23,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7633157263478609076_1013 src: /127.0.0.1:46193 dest: /127.0.0.1:37740
2013-10-31 18:27:23,109 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46193, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7633157263478609076_1013, duration: 3051956
2013-10-31 18:27:23,110 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,111 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49104, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7633157263478609076_1013, duration: 4164155
2013-10-31 18:27:23,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,112 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,113 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46474, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7633157263478609076_1013, duration: 4748037
2013-10-31 18:27:23,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42299, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 6939493
2013-10-31 18:27:23,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7633157263478609076_1013 terminating
2013-10-31 18:27:23,118 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,120 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split from client DFSClient_-1596270109
2013-10-31 18:27:23,120 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split is closed by DFSClient_-1596270109
2013-10-31 18:27:23,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7633157263478609076_1013 size 1403
2013-10-31 18:27:23,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,139 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo. blk_1098547203853784091_1014
2013-10-31 18:27:23,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:49106 dest: /127.0.0.1:34578
2013-10-31 18:27:23,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:46195 dest: /127.0.0.1:37740
2013-10-31 18:27:23,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1098547203853784091_1014 src: /127.0.0.1:42305 dest: /127.0.0.1:59471
2013-10-31 18:27:23,148 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42305, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1098547203853784091_1014, duration: 687959
2013-10-31 18:27:23,149 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,150 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46195, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1098547203853784091_1014, duration: 2643080
2013-10-31 18:27:23,151 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,152 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49106, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1098547203853784091_1014, duration: 4713377
2013-10-31 18:27:23,153 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1098547203853784091_1014 terminating
2013-10-31 18:27:23,156 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,156 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:27:23,157 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:27:23,157 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1098547203853784091_1014 size 156
2013-10-31 18:27:23,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,192 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml. blk_-5355324456686587546_1015
2013-10-31 18:27:23,194 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:46480 dest: /127.0.0.1:54365
2013-10-31 18:27:23,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:42307 dest: /127.0.0.1:59471
2013-10-31 18:27:23,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5355324456686587546_1015 src: /127.0.0.1:49111 dest: /127.0.0.1:34578
2013-10-31 18:27:23,203 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49111, dest: /127.0.0.1:34578, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5355324456686587546_1015, duration: 2359904
2013-10-31 18:27:23,203 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,205 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42307, dest: /127.0.0.1:59471, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5355324456686587546_1015, duration: 4314514
2013-10-31 18:27:23,205 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,207 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,207 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46480, dest: /127.0.0.1:54365, bytes: 28794, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 6535415
2013-10-31 18:27:23,208 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5355324456686587546_1015 terminating
2013-10-31 18:27:23,208 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,211 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml from client DFSClient_-1596270109
2013-10-31 18:27:23,212 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:27:23,212 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5355324456686587546_1015 size 28794
2013-10-31 18:27:23,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=null
2013-10-31 18:27:23,223 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46484, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 266396
2013-10-31 18:27:23,232 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0002: nMaps=4 nReduces=1 max=-1
2013-10-31 18:27:23,233 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0002 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:27:23,233 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0002 RESULT=SUCCESS
2013-10-31 18:27:23,233 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0002
2013-10-31 18:27:23,234 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0002
2013-10-31 18:27:23,235 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0002
2013-10-31 18:27:23,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,265 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml. blk_5326914040277870060_1017
2013-10-31 18:27:23,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:46202 dest: /127.0.0.1:37740
2013-10-31 18:27:23,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:42312 dest: /127.0.0.1:59471
2013-10-31 18:27:23,268 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5326914040277870060_1017 src: /127.0.0.1:46487 dest: /127.0.0.1:54365
2013-10-31 18:27:23,273 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46487, dest: /127.0.0.1:54365, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5326914040277870060_1017, duration: 3624755
2013-10-31 18:27:23,274 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,275 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42312, dest: /127.0.0.1:59471, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5326914040277870060_1017, duration: 5116969
2013-10-31 18:27:23,275 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,276 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46202, dest: /127.0.0.1:37740, bytes: 28859, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5326914040277870060_1017, duration: 6273902
2013-10-31 18:27:23,277 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5326914040277870060_1017 terminating
2013-10-31 18:27:23,280 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,281 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml from client DFSClient_-1705714739
2013-10-31 18:27:23,281 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_conf.xml is closed by DFSClient_-1705714739
2013-10-31 18:27:23,282 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,282 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5326914040277870060_1017 size 28859
2013-10-31 18:27:23,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:23,299 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken. blk_2577997513305980578_1018
2013-10-31 18:27:23,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:49117 dest: /127.0.0.1:34578
2013-10-31 18:27:23,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:46489 dest: /127.0.0.1:54365
2013-10-31 18:27:23,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2577997513305980578_1018 src: /127.0.0.1:42316 dest: /127.0.0.1:59471
2013-10-31 18:27:23,309 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42316, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2577997513305980578_1018, duration: 1884074
2013-10-31 18:27:23,310 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,310 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46489, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 2838029
2013-10-31 18:27:23,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49117, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2577997513305980578_1018, duration: 3990192
2013-10-31 18:27:23,312 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2577997513305980578_1018 terminating
2013-10-31 18:27:23,315 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,316 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken from client DFSClient_-1596270109
2013-10-31 18:27:23,316 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:27:23,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2577997513305980578_1018 size 116
2013-10-31 18:27:23,322 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken
2013-10-31 18:27:23,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.splitmetainfo dst=null perm=null
2013-10-31 18:27:23,328 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46208, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1098547203853784091_1014, duration: 402990
2013-10-31 18:27:23,332 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0002 = 1449. Number of splits = 4
2013-10-31 18:27:23,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,332 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,333 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,334 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,335 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0002_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:27:23,335 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0002 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:27:23,336 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0002 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:27:23,931 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0002_m_000005_0' to tip task_20131031182606197_0002_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:23,936 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:27:23,937 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000005_0 which needs 1 slots
2013-10-31 18:27:23,937 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000005_0 which needs 1 slots
2013-10-31 18:27:23,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken dst=null perm=null
2013-10-31 18:27:23,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42321, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2577997513305980578_1018, duration: 461199
2013-10-31 18:27:23,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=null
2013-10-31 18:27:23,965 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46497, bytes: 29022, op: HDFS_READ, cliID: DFSClient_912982788, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 604137
2013-10-31 18:27:24,005 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:24,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=null
2013-10-31 18:27:24,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46498, bytes: 239915, op: HDFS_READ, cliID: DFSClient_912982788, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 2216858
2013-10-31 18:27:24,141 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_519201635
2013-10-31 18:27:24,142 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_519201635 spawned.
2013-10-31 18:27:24,145 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000005_0/taskjvm.sh
2013-10-31 18:27:26,364 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_519201635 given task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:26,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:29,823 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000005_0 0.0% setup
2013-10-31 18:27:29,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000005_0 is done.
2013-10-31 18:27:29,828 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000005_0 was -1
2013-10-31 18:27:29,828 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:29,944 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000005_0' has completed task_20131031182606197_0002_m_000005 successfully.
2013-10-31 18:27:29,950 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000000_0' to tip task_20131031182606197_0002_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:29,952 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000000
2013-10-31 18:27:29,954 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:27:29,954 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000000_0 which needs 1 slots
2013-10-31 18:27:29,955 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000000_0 which needs 1 slots
2013-10-31 18:27:29,996 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-710253377
2013-10-31 18:27:29,997 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-710253377 spawned.
2013-10-31 18:27:30,000 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000000_0/taskjvm.sh
2013-10-31 18:27:30,671 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000001_0' to tip task_20131031182606197_0002_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:27:30,672 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000001
2013-10-31 18:27:30,673 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:27:30,674 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000001_0 which needs 1 slots
2013-10-31 18:27:30,674 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000001_0 which needs 1 slots
2013-10-31 18:27:30,674 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000002_0' to tip task_20131031182606197_0002_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:27:30,674 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000002
2013-10-31 18:27:30,676 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:27:30,676 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000002_0 which needs 1 slots
2013-10-31 18:27:30,676 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000002_0 which needs 1 slots
2013-10-31 18:27:30,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken dst=null perm=null
2013-10-31 18:27:30,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken dst=null perm=null
2013-10-31 18:27:30,688 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46505, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 417267
2013-10-31 18:27:30,690 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49135, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2577997513305980578_1018, duration: 196525
2013-10-31 18:27:30,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=null
2013-10-31 18:27:30,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=null
2013-10-31 18:27:30,697 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49138, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-781359484, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5355324456686587546_1015, duration: 256052
2013-10-31 18:27:30,698 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46510, bytes: 29022, op: HDFS_READ, cliID: DFSClient_-808314366, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 261310
2013-10-31 18:27:30,716 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:30,716 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:30,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=null
2013-10-31 18:27:30,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=null
2013-10-31 18:27:30,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49140, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-808314366, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2141313976185548712_1012, duration: 1338908
2013-10-31 18:27:30,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46229, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-781359484, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2141313976185548712_1012, duration: 1354546
2013-10-31 18:27:30,806 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_1834196118
2013-10-31 18:27:30,806 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-2128071556
2013-10-31 18:27:30,807 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_1834196118 spawned.
2013-10-31 18:27:30,807 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-2128071556 spawned.
2013-10-31 18:27:30,809 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000001_0/taskjvm.sh
2013-10-31 18:27:30,809 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000002_0/taskjvm.sh
2013-10-31 18:27:31,409 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-710253377 given task: attempt_20131031182606197_0002_m_000000_0
2013-10-31 18:27:31,629 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0002_m_000003_0' to tip task_20131031182606197_0002_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:27:31,629 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0002_m_000003
2013-10-31 18:27:31,630 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:27:31,630 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000003_0 which needs 1 slots
2013-10-31 18:27:31,630 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000003_0 which needs 1 slots
2013-10-31 18:27:31,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002/jobToken dst=null perm=null
2013-10-31 18:27:31,636 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46514, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2577997513305980578_1018, duration: 195747
2013-10-31 18:27:31,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.xml dst=null perm=null
2013-10-31 18:27:31,643 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46516, bytes: 29022, op: HDFS_READ, cliID: DFSClient_1518586653, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5355324456686587546_1015, duration: 247252
2013-10-31 18:27:31,658 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:27:31,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.jar dst=null perm=null
2013-10-31 18:27:31,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46517, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1518586653, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2141313976185548712_1012, duration: 1221177
2013-10-31 18:27:31,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=null
2013-10-31 18:27:31,927 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49148, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7633157263478609076_1013, duration: 555660
2013-10-31 18:27:31,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:27:31,970 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46237, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 387762
2013-10-31 18:27:33,743 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_m_-1747545474
2013-10-31 18:27:33,744 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_m_-1747545474 spawned.
2013-10-31 18:27:33,748 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_m_000003_0/taskjvm.sh
2013-10-31 18:27:34,549 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-2128071556 given task: attempt_20131031182606197_0002_m_000001_0
2013-10-31 18:27:34,840 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:27:34,842 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000000_0 is done.
2013-10-31 18:27:34,842 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000000_0 was 54
2013-10-31 18:27:34,842 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:34,877 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_1834196118 given task: attempt_20131031182606197_0002_m_000002_0
2013-10-31 18:27:34,950 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-1747545474 given task: attempt_20131031182606197_0002_m_000003_0
2013-10-31 18:27:34,955 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:34,955 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0002_m_000005_0
2013-10-31 18:27:34,955 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0002_m_000005_0 not found in cache
2013-10-31 18:27:35,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=null
2013-10-31 18:27:35,052 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46528, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7633157263478609076_1013, duration: 256947
2013-10-31 18:27:35,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:27:35,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46247, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 264175
2013-10-31 18:27:35,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=null
2013-10-31 18:27:35,384 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42358, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 246113
2013-10-31 18:27:35,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:27:35,423 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46533, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 256550
2013-10-31 18:27:35,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002/job.split dst=null perm=null
2013-10-31 18:27:35,453 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42360, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7633157263478609076_1013, duration: 179661
2013-10-31 18:27:35,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:27:35,492 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49164, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0002_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 236302
2013-10-31 18:27:35,963 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000000_0' has completed task_20131031182606197_0002_m_000000 successfully.
2013-10-31 18:27:35,967 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0002_r_000000_0' to tip task_20131031182606197_0002_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:36,014 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:27:36,014 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_r_000000_0 which needs 1 slots
2013-10-31 18:27:36,015 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_r_000000_0 which needs 1 slots
2013-10-31 18:27:36,036 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0002_r_1448684247
2013-10-31 18:27:36,037 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0002_r_1448684247 spawned.
2013-10-31 18:27:36,038 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0002/attempt_20131031182606197_0002_r_000000_0/taskjvm.sh
2013-10-31 18:27:37,977 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:27:37,981 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000001_0 is done.
2013-10-31 18:27:37,981 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000001_0 was 74
2013-10-31 18:27:37,982 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,306 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:27:38,307 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000002_0 is done.
2013-10-31 18:27:38,308 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000002_0 was 73
2013-10-31 18:27:38,308 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,379 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:27:38,382 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000003_0 is done.
2013-10-31 18:27:38,382 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000003_0 was 53
2013-10-31 18:27:38,383 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:38,983 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_r_1448684247 given task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:39,691 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000001_0' has completed task_20131031182606197_0002_m_000001 successfully.
2013-10-31 18:27:39,695 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000002_0' has completed task_20131031182606197_0002_m_000002 successfully.
2013-10-31 18:27:40,641 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000003_0' has completed task_20131031182606197_0002_m_000003 successfully.
2013-10-31 18:27:44,700 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38549, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000000_0, duration: 9324732
2013-10-31 18:27:44,728 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40571, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000001_0, duration: 13263839
2013-10-31 18:27:44,746 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48206, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000002_0, duration: 12970897
2013-10-31 18:27:44,764 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43249, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0002_m_000003_0, duration: 12961983
2013-10-31 18:27:45,485 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,561 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,624 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:45,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:47,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:47,580 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000. blk_-4839348806796864519_1019
2013-10-31 18:27:47,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:46260 dest: /127.0.0.1:37740
2013-10-31 18:27:47,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:46544 dest: /127.0.0.1:54365
2013-10-31 18:27:47,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4839348806796864519_1019 src: /127.0.0.1:42371 dest: /127.0.0.1:59471
2013-10-31 18:27:47,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42371, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4839348806796864519_1019, duration: 2911943
2013-10-31 18:27:47,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,632 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46544, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4839348806796864519_1019, duration: 4555341
2013-10-31 18:27:47,632 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,632 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,633 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46260, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0002_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 5630100
2013-10-31 18:27:47,633 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4839348806796864519_1019 terminating
2013-10-31 18:27:47,633 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,635 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:47,636 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:47,637 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4839348806796864519_1019 size 176
2013-10-31 18:27:47,672 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0002_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:27:47,672 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:27:48,030 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0002_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:27:48,033 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:27:48,534 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:48,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0 dst=null perm=null
2013-10-31 18:27:48,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:27:48,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:48,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary/_attempt_20131031182606197_0002_r_000000_0 dst=null perm=null
2013-10-31 18:27:51,574 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:51,578 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_r_000000_0 1.0% reduce > reduce
2013-10-31 18:27:51,580 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_r_000000_0 is done.
2013-10-31 18:27:51,580 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_r_000000_0 was -1
2013-10-31 18:27:51,581 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:27:54,040 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_r_000000_0' has completed task_20131031182606197_0002_r_000000 successfully.
2013-10-31 18:27:56,009 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:27:56,017 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:27:56,048 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:27:57,548 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0002_m_000004_0' to tip task_20131031182606197_0002_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:27:57,551 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0002_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:27:57,551 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0002_m_000004_0 which needs 1 slots
2013-10-31 18:27:57,552 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0002_m_000004_0 which needs 1 slots
2013-10-31 18:27:57,581 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0002/attempt_20131031182606197_0002_m_000004_0. Attempting to reuse: jvm_20131031182606197_0002_m_-710253377
2013-10-31 18:27:57,911 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0002_m_-710253377 given task: attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,035 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000004_0 0.0%
2013-10-31 18:27:58,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary dst=null perm=null
2013-10-31 18:27:58,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:27:58,056 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS from client DFSClient_attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,057 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0002_m_000004_0
2013-10-31 18:27:58,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2141313976185548712 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7633157263478609076 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1098547203853784091 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:27:58,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5355324456686587546 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:27:58,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0002 dst=null perm=null
2013-10-31 18:27:58,338 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-5355324456686587546_1015 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:27:58,338 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:27:58,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data3/current/blk_-5355324456686587546 for deletion
2013-10-31 18:27:58,939 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data3/current/blk_-2141313976185548712 for deletion
2013-10-31 18:27:58,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data3/current/blk_-5355324456686587546
2013-10-31 18:27:58,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data4/current/blk_7633157263478609076 for deletion
2013-10-31 18:27:58,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data3/current/blk_-2141313976185548712
2013-10-31 18:27:58,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data4/current/blk_7633157263478609076
2013-10-31 18:28:00,138 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data7/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:00,138 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data7/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:00,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data7/current/blk_-2141313976185548712
2013-10-31 18:28:00,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data8/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:00,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data7/current/blk_1098547203853784091
2013-10-31 18:28:00,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data8/current/blk_7633157263478609076
2013-10-31 18:28:00,988 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0002_m_000004_0 0.0% cleanup
2013-10-31 18:28:00,990 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0002_m_000004_0 is done.
2013-10-31 18:28:00,991 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0002_m_000004_0 was -1
2013-10-31 18:28:00,991 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:01,339 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-5355324456686587546_1015 blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:28:01,339 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-5355324456686587546_1015 blk_1098547203853784091_1014 blk_7633157263478609076_1013 blk_-2141313976185548712_1012
2013-10-31 18:28:02,552 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:28:02,552 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0002_r_000000_0
2013-10-31 18:28:02,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data6/current/blk_-5355324456686587546 for deletion
2013-10-31 18:28:02,652 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data5/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:02,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data6/current/blk_-5355324456686587546
2013-10-31 18:28:02,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data5/current/blk_-2141313976185548712
2013-10-31 18:28:02,653 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data5/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:02,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data5/current/blk_1098547203853784091
2013-10-31 18:28:02,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data6/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:02,655 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data6/current/blk_7633157263478609076
2013-10-31 18:28:03,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5355324456686587546_1015 file build/test/data/dfs/data/data2/current/blk_-5355324456686587546 for deletion
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2141313976185548712_1012 file build/test/data/dfs/data/data1/current/blk_-2141313976185548712 for deletion
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1098547203853784091_1014 file build/test/data/dfs/data/data1/current/blk_1098547203853784091 for deletion
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7633157263478609076_1013 file build/test/data/dfs/data/data2/current/blk_7633157263478609076 for deletion
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2141313976185548712_1012 at file build/test/data/dfs/data/data1/current/blk_-2141313976185548712
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5355324456686587546_1015 at file build/test/data/dfs/data/data2/current/blk_-5355324456686587546
2013-10-31 18:28:03,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1098547203853784091_1014 at file build/test/data/dfs/data/data1/current/blk_1098547203853784091
2013-10-31 18:28:03,064 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7633157263478609076_1013 at file build/test/data/dfs/data/data2/current/blk_7633157263478609076
2013-10-31 18:28:03,599 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0002_m_000004_0' has completed task_20131031182606197_0002_m_000004 successfully.
2013-10-31 18:28:03,601 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0002 has completed successfully.
2013-10-31 18:28:03,601 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0002,submitTime=1383244043217,launchTime=1383244043335,firstMapTaskLaunchTime=1383244049950,firstReduceTaskLaunchTime=1383244055967,firstJobSetupTaskLaunchTime=1383244043931,firstJobCleanupTaskLaunchTime=1383244077547,finishTime=1383244083601,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=15,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[F209A64EAB6A419D895DEAA1AF79ADDD/BE9B10B1F8E84FA6B13F3479451BF843] test/(1/1) ...pipesplatform/simplechain
2013-10-31 18:28:03,606 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6. blk_-4203961431443320417_1020
2013-10-31 18:28:03,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:46267 dest: /127.0.0.1:37740
2013-10-31 18:28:03,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:42377 dest: /127.0.0.1:59471
2013-10-31 18:28:03,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4203961431443320417_1020 src: /127.0.0.1:46552 dest: /127.0.0.1:54365
2013-10-31 18:28:03,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46552, dest: /127.0.0.1:54365, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4203961431443320417_1020, duration: 3439307
2013-10-31 18:28:03,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,614 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,615 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42377, dest: /127.0.0.1:59471, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4203961431443320417_1020, duration: 5324303
2013-10-31 18:28:03,616 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,617 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46267, dest: /127.0.0.1:37740, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-1705714739, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4203961431443320417_1020, duration: 6840849
2013-10-31 18:28:03,617 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4203961431443320417_1020 terminating
2013-10-31 18:28:03,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,619 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 from client DFSClient_-1705714739
2013-10-31 18:28:03,619 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_logs/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 is closed by DFSClient_-1705714739
2013-10-31 18:28:03,619 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4203961431443320417_1020 size 28304
2013-10-31 18:28:03,626 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0002_1383244043217_hadoop_%5BF209A64EAB6A419D895DEAA1AF79ADDD%2FBE9B10B1F8E84FA6 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:03,629 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000000_0'
2013-10-31 18:28:03,629 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000004_0'
2013-10-31 18:28:03,629 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000005_0'
2013-10-31 18:28:03,629 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_r_000000_0'
2013-10-31 18:28:03,629 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:03,630 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:03,630 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2577997513305980578 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:03,633 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0002_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:03,639 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/_temporary
2013-10-31 18:28:03,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0002 dst=null perm=null
2013-10-31 18:28:03,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain dst=null perm=null
2013-10-31 18:28:03,702 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:03,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000 dst=null perm=null
2013-10-31 18:28:03,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000 dst=null perm=null
2013-10-31 18:28:03,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46271, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 351336
2013-10-31 18:28:03,713 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplechain
2013-10-31 18:28:03,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain dst=null perm=null
2013-10-31 18:28:03,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplechain/part-00000 dst=null perm=null
2013-10-31 18:28:03,724 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46272, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4839348806796864519_1019, duration: 325583
2013-10-31 18:28:03,745 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:28:03,746 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:28:03,765 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:28:03,766 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:28:03,766 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple"]
2013-10-31 18:28:03,767 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:28:03,767 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:28:03,767 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:28:03,768 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...eldedpipesplatform/simple
2013-10-31 18:28:03,776 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:28:03,776 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:28:03,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:03,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:28:03,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,803 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar. blk_2161431310787054464_1021
2013-10-31 18:28:03,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:46273 dest: /127.0.0.1:37740
2013-10-31 18:28:03,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:49186 dest: /127.0.0.1:34578
2013-10-31 18:28:03,808 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:42384 dest: /127.0.0.1:59471
2013-10-31 18:28:03,820 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42384, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 8622578
2013-10-31 18:28:03,821 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,822 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49186, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2161431310787054464_1021, duration: 10152071
2013-10-31 18:28:03,822 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,823 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46273, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2161431310787054464_1021, duration: 12358815
2013-10-31 18:28:03,824 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2161431310787054464_1021 terminating
2013-10-31 18:28:03,826 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar from client DFSClient_-1596270109
2013-10-31 18:28:03,826 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:28:03,827 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,827 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:03,832 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar. New replication is 10
2013-10-31 18:28:03,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=null
2013-10-31 18:28:03,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,843 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:28:03,849 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:03,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:03,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:03,867 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split. New replication is 10
2013-10-31 18:28:03,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=null
2013-10-31 18:28:03,876 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split. blk_1895370450695675842_1022
2013-10-31 18:28:03,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:46276 dest: /127.0.0.1:37740
2013-10-31 18:28:03,880 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:46560 dest: /127.0.0.1:54365
2013-10-31 18:28:03,881 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:49190 dest: /127.0.0.1:34578
2013-10-31 18:28:03,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1895370450695675842_1022 src: /127.0.0.1:42388 dest: /127.0.0.1:59471
2013-10-31 18:28:03,887 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42388, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1895370450695675842_1022, duration: 987671
2013-10-31 18:28:03,888 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,889 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49190, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 2527051
2013-10-31 18:28:03,889 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,890 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,891 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46560, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1895370450695675842_1022, duration: 4343509
2013-10-31 18:28:03,891 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,891 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46276, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1895370450695675842_1022, duration: 6187780
2013-10-31 18:28:03,893 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1895370450695675842_1022 terminating
2013-10-31 18:28:03,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1895370450695675842_1022 size 1403
2013-10-31 18:28:03,896 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split from client DFSClient_-1596270109
2013-10-31 18:28:03,896 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split is closed by DFSClient_-1596270109
2013-10-31 18:28:04,340 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_2161431310787054464_1021 to datanode(s) 127.0.0.1:54365
2013-10-31 18:28:04,340 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_2577997513305980578_1018
2013-10-31 18:28:04,341 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_2577997513305980578_1018
2013-10-31 18:28:04,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,648 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 133 Total time for transactions(ms): 6Number of transactions batched in Syncs: 4 Number of syncs: 86 SyncTimes(ms): 18017 4417
2013-10-31 18:28:04,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,654 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo. blk_3560951954507469203_1023
2013-10-31 18:28:04,656 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:46280 dest: /127.0.0.1:37740
2013-10-31 18:28:04,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:42390 dest: /127.0.0.1:59471
2013-10-31 18:28:04,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3560951954507469203_1023 src: /127.0.0.1:46565 dest: /127.0.0.1:54365
2013-10-31 18:28:04,663 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46565, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3560951954507469203_1023, duration: 798415
2013-10-31 18:28:04,664 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42390, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3560951954507469203_1023, duration: 2392277
2013-10-31 18:28:04,665 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,666 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,667 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,667 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46280, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3560951954507469203_1023, duration: 4395728
2013-10-31 18:28:04,668 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3560951954507469203_1023 terminating
2013-10-31 18:28:04,670 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:28:04,670 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:28:04,672 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3560951954507469203_1023 size 156
2013-10-31 18:28:04,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,694 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml. blk_8381546173571133180_1024
2013-10-31 18:28:04,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:49195 dest: /127.0.0.1:34578
2013-10-31 18:28:04,698 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:42393 dest: /127.0.0.1:59471
2013-10-31 18:28:04,700 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8381546173571133180_1024 src: /127.0.0.1:46285 dest: /127.0.0.1:37740
2013-10-31 18:28:04,703 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46285, dest: /127.0.0.1:37740, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8381546173571133180_1024, duration: 2244273
2013-10-31 18:28:04,704 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,705 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,706 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42393, dest: /127.0.0.1:59471, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 3433267
2013-10-31 18:28:04,706 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,706 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,708 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49195, dest: /127.0.0.1:34578, bytes: 28129, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8381546173571133180_1024, duration: 5498877
2013-10-31 18:28:04,708 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8381546173571133180_1024 terminating
2013-10-31 18:28:04,710 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml from client DFSClient_-1596270109
2013-10-31 18:28:04,710 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:28:04,711 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8381546173571133180_1024 size 28129
2013-10-31 18:28:04,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=null
2013-10-31 18:28:04,731 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46287, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8381546173571133180_1024, duration: 546318
2013-10-31 18:28:04,751 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0003: nMaps=4 nReduces=1 max=-1
2013-10-31 18:28:04,753 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0003 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:28:04,753 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0003 RESULT=SUCCESS
2013-10-31 18:28:04,753 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0003
2013-10-31 18:28:04,754 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0003
2013-10-31 18:28:04,754 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0003
2013-10-31 18:28:04,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,795 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml. blk_6154256141097845787_1026
2013-10-31 18:28:04,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:42397 dest: /127.0.0.1:59471
2013-10-31 18:28:04,799 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:46572 dest: /127.0.0.1:54365
2013-10-31 18:28:04,801 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6154256141097845787_1026 src: /127.0.0.1:49202 dest: /127.0.0.1:34578
2013-10-31 18:28:04,806 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49202, dest: /127.0.0.1:34578, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6154256141097845787_1026, duration: 1506855
2013-10-31 18:28:04,806 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,807 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46572, dest: /127.0.0.1:54365, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6154256141097845787_1026, duration: 3039447
2013-10-31 18:28:04,808 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,810 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42397, dest: /127.0.0.1:59471, bytes: 28194, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6154256141097845787_1026, duration: 5696353
2013-10-31 18:28:04,810 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,810 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6154256141097845787_1026 terminating
2013-10-31 18:28:04,812 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,813 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml from client DFSClient_-598798051
2013-10-31 18:28:04,813 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_conf.xml is closed by DFSClient_-598798051
2013-10-31 18:28:04,813 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6154256141097845787_1026 size 28194
2013-10-31 18:28:04,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:04,825 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken. blk_1264182116435781743_1027
2013-10-31 18:28:04,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:46291 dest: /127.0.0.1:37740
2013-10-31 18:28:04,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:42401 dest: /127.0.0.1:59471
2013-10-31 18:28:04,830 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1264182116435781743_1027 src: /127.0.0.1:49205 dest: /127.0.0.1:34578
2013-10-31 18:28:04,838 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49205, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1264182116435781743_1027, duration: 2252011
2013-10-31 18:28:04,838 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,838 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42401, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1264182116435781743_1027, duration: 3153445
2013-10-31 18:28:04,839 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,839 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46291, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 4054846
2013-10-31 18:28:04,840 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1264182116435781743_1027 terminating
2013-10-31 18:28:04,842 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken from client DFSClient_-1596270109
2013-10-31 18:28:04,843 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:28:04,843 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,843 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1264182116435781743_1027 size 116
2013-10-31 18:28:04,847 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken
2013-10-31 18:28:04,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.splitmetainfo dst=null perm=null
2013-10-31 18:28:04,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46294, bytes: 160, op: HDFS_READ, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3560951954507469203_1023, duration: 351873
2013-10-31 18:28:04,861 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0003 = 1449. Number of splits = 4
2013-10-31 18:28:04,861 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,861 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,861 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,862 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,863 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0003_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:04,864 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0003 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:28:04,865 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0003 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:28:04,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data3/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:04,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data3/current/blk_2577997513305980578
2013-10-31 18:28:06,064 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_2161431310787054464_1021 to 127.0.0.1:54365
2013-10-31 18:28:06,065 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data1/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:06,065 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data1/current/blk_2577997513305980578
2013-10-31 18:28:06,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2161431310787054464_1021 src: /127.0.0.1:46578 dest: /127.0.0.1:54365
2013-10-31 18:28:06,067 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_2161431310787054464_1021 to /127.0.0.1:54365
2013-10-31 18:28:06,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_2161431310787054464_1021 src: /127.0.0.1:46578 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:28:06,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2161431310787054464_1021 size 238055
2013-10-31 18:28:06,564 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0003_m_000005_0' to tip task_20131031182606197_0003_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:06,568 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000002_0'
2013-10-31 18:28:06,570 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000003_0'
2013-10-31 18:28:06,571 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:28:06,571 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000005_0 which needs 1 slots
2013-10-31 18:28:06,571 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000005_0 which needs 1 slots
2013-10-31 18:28:06,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken dst=null perm=null
2013-10-31 18:28:06,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46296, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 349261
2013-10-31 18:28:06,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=null
2013-10-31 18:28:06,585 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49210, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-1351708163, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8381546173571133180_1024, duration: 508847
2013-10-31 18:28:06,600 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:06,601 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0002_m_000001_0'
2013-10-31 18:28:06,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=null
2013-10-31 18:28:06,624 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46582, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1351708163, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2161431310787054464_1021, duration: 2349848
2013-10-31 18:28:06,741 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_259930158
2013-10-31 18:28:06,742 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_259930158 spawned.
2013-10-31 18:28:06,745 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000005_0/taskjvm.sh
2013-10-31 18:28:07,341 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_2577997513305980578_1018
2013-10-31 18:28:08,631 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:08,631 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0002_m_000004_0 not found in cache
2013-10-31 18:28:08,632 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330488632
2013-10-31 18:28:08,639 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_r_1448684247 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:08,649 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16557 with signal TERM. Exit code 0
2013-10-31 18:28:08,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2577997513305980578_1018 file build/test/data/dfs/data/data6/current/blk_2577997513305980578 for deletion
2013-10-31 18:28:08,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2577997513305980578_1018 at file build/test/data/dfs/data/data6/current/blk_2577997513305980578
2013-10-31 18:28:08,815 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:08,815 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:08,815 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:08,815 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_r_1448684247 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:09,023 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-710253377 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:09,033 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16282 with signal TERM. Exit code 0
2013-10-31 18:28:09,216 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:09,216 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:09,216 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:09,216 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-710253377 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:28:09,896 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_519201635 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:09,904 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16214 with signal TERM. Exit code 0
2013-10-31 18:28:10,071 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:10,071 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:10,071 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:10,071 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_519201635 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:10,443 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_259930158 given task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:10,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:11,571 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,571 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491572
2013-10-31 18:28:11,573 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491573
2013-10-31 18:28:11,602 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0002
2013-10-31 18:28:11,603 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0002 for user-log deletion with retainTimeStamp:1383330491603
2013-10-31 18:28:11,758 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-2128071556 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,769 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16391 with signal TERM. Exit code 0
2013-10-31 18:28:11,893 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_1834196118 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,898 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16426 with signal TERM. Exit code 0
2013-10-31 18:28:11,966 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0002_m_-1747545474 since job job_20131031182606197_0002 is dead
2013-10-31 18:28:11,971 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16461 with signal TERM. Exit code 0
2013-10-31 18:28:11,990 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:11,990 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:11,990 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:11,990 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-2128071556 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:12,086 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:12,086 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:12,086 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:12,086 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_1834196118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:12,180 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:12,180 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:12,180 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:12,180 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0002_m_-1747545474 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:13,875 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000005_0 0.0% setup
2013-10-31 18:28:13,879 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000005_0 is done.
2013-10-31 18:28:13,880 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000005_0 was -1
2013-10-31 18:28:13,880 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:15,584 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000005_0' has completed task_20131031182606197_0003_m_000005 successfully.
2013-10-31 18:28:15,588 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000000_0' to tip task_20131031182606197_0003_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:15,589 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000000
2013-10-31 18:28:15,591 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:15,591 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000000_0 which needs 1 slots
2013-10-31 18:28:15,591 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000001_0' to tip task_20131031182606197_0003_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:28:15,591 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000000_0 which needs 1 slots
2013-10-31 18:28:15,594 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000001
2013-10-31 18:28:15,597 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:28:15,598 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000001_0 which needs 1 slots
2013-10-31 18:28:15,598 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000001_0 which needs 1 slots
2013-10-31 18:28:15,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken dst=null perm=null
2013-10-31 18:28:15,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49215, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1264182116435781743_1027, duration: 371567
2013-10-31 18:28:15,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=null
2013-10-31 18:28:15,611 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42414, bytes: 28349, op: HDFS_READ, cliID: DFSClient_-707125352, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 277597
2013-10-31 18:28:15,612 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000002_0' to tip task_20131031182606197_0003_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:15,612 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000002
2013-10-31 18:28:15,614 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:28:15,614 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000002_0 which needs 1 slots
2013-10-31 18:28:15,614 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000002_0 which needs 1 slots
2013-10-31 18:28:15,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken dst=null perm=null
2013-10-31 18:28:15,622 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46306, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1264182116435781743_1027, duration: 361636
2013-10-31 18:28:15,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=null
2013-10-31 18:28:15,629 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42417, bytes: 28349, op: HDFS_READ, cliID: DFSClient_490291153, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 219044
2013-10-31 18:28:15,630 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,637 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_-1824933735
2013-10-31 18:28:15,637 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_-1824933735 spawned.
2013-10-31 18:28:15,639 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000000_0/taskjvm.sh
2013-10-31 18:28:15,644 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,645 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0003_m_000003_0' to tip task_20131031182606197_0003_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:15,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=null
2013-10-31 18:28:15,653 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49221, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-707125352, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2161431310787054464_1021, duration: 1023536
2013-10-31 18:28:15,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=null
2013-10-31 18:28:15,664 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42419, bytes: 239915, op: HDFS_READ, cliID: DFSClient_490291153, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 1064725
2013-10-31 18:28:15,681 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0003_m_000003
2013-10-31 18:28:15,682 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:28:15,683 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000003_0 which needs 1 slots
2013-10-31 18:28:15,683 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000003_0 which needs 1 slots
2013-10-31 18:28:15,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003/jobToken dst=null perm=null
2013-10-31 18:28:15,688 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42420, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1264182116435781743_1027, duration: 162751
2013-10-31 18:28:15,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.xml dst=null perm=null
2013-10-31 18:28:15,694 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42422, bytes: 28349, op: HDFS_READ, cliID: DFSClient_1597706183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8381546173571133180_1024, duration: 212822
2013-10-31 18:28:15,710 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:15,717 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_606975538
2013-10-31 18:28:15,717 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_606975538 spawned.
2013-10-31 18:28:15,719 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000001_0/taskjvm.sh
2013-10-31 18:28:15,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.jar dst=null perm=null
2013-10-31 18:28:15,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42423, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1597706183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2161431310787054464_1021, duration: 1016231
2013-10-31 18:28:15,731 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_-594210753
2013-10-31 18:28:15,732 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_-594210753 spawned.
2013-10-31 18:28:15,733 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000002_0/taskjvm.sh
2013-10-31 18:28:16,461 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_m_1908169258
2013-10-31 18:28:16,461 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_m_1908169258 spawned.
2013-10-31 18:28:16,463 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_m_000003_0/taskjvm.sh
2013-10-31 18:28:16,543 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_-1824933735 given task: attempt_20131031182606197_0003_m_000000_0
2013-10-31 18:28:17,281 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_606975538 given task: attempt_20131031182606197_0003_m_000001_0
2013-10-31 18:28:17,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=null
2013-10-31 18:28:17,324 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49230, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 208299
2013-10-31 18:28:17,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:17,364 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49231, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 139444
2013-10-31 18:28:17,734 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_1908169258 given task: attempt_20131031182606197_0003_m_000003_0
2013-10-31 18:28:17,758 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_-594210753 given task: attempt_20131031182606197_0003_m_000002_0
2013-10-31 18:28:17,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=null
2013-10-31 18:28:17,781 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46606, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1895370450695675842_1022, duration: 201975
2013-10-31 18:28:17,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:18,071 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46324, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 220863
2013-10-31 18:28:18,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=null
2013-10-31 18:28:18,241 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49239, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1895370450695675842_1022, duration: 158320
2013-10-31 18:28:18,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003/job.split dst=null perm=null
2013-10-31 18:28:18,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46328, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1895370450695675842_1022, duration: 204455
2013-10-31 18:28:18,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:18,281 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46329, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 202479
2013-10-31 18:28:18,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:18,301 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46613, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0003_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 238979
2013-10-31 18:28:20,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:28:20,253 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000000_0 is done.
2013-10-31 18:28:20,253 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000000_0 was 54
2013-10-31 18:28:20,254 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:20,591 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:20,592 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0003_m_000005_0
2013-10-31 18:28:20,592 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0003_m_000005_0 not found in cache
2013-10-31 18:28:20,708 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:28:20,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000001_0 is done.
2013-10-31 18:28:20,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000001_0 was 74
2013-10-31 18:28:20,711 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,003 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 93 raw values into 1 aggregated values, total 24
2013-10-31 18:28:21,172 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:28:21,175 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000003_0 is done.
2013-10-31 18:28:21,176 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000003_0 was 53
2013-10-31 18:28:21,176 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,193 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:28:21,195 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000002_0 is done.
2013-10-31 18:28:21,195 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000002_0 was 73
2013-10-31 18:28:21,195 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:21,596 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000000_0' has completed task_20131031182606197_0003_m_000000 successfully.
2013-10-31 18:28:21,796 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0003_r_000000_0' to tip task_20131031182606197_0003_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:21,798 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000003_0' has completed task_20131031182606197_0003_m_000003 successfully.
2013-10-31 18:28:21,800 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:21,801 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_r_000000_0 which needs 1 slots
2013-10-31 18:28:21,801 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_r_000000_0 which needs 1 slots
2013-10-31 18:28:21,804 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000002_0' has completed task_20131031182606197_0003_m_000002 successfully.
2013-10-31 18:28:21,812 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000001_0' has completed task_20131031182606197_0003_m_000001 successfully.
2013-10-31 18:28:21,840 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0003_r_1010257680
2013-10-31 18:28:21,841 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0003_r_1010257680 spawned.
2013-10-31 18:28:21,842 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0003/attempt_20131031182606197_0003_r_000000_0/taskjvm.sh
2013-10-31 18:28:22,827 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_r_1010257680 given task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:28,522 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48281, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000000_0, duration: 5994958
2013-10-31 18:28:28,534 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38627, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000003_0, duration: 6112963
2013-10-31 18:28:28,553 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40649, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000002_0, duration: 13241719
2013-10-31 18:28:28,571 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43326, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0003_m_000001_0, duration: 13180727
2013-10-31 18:28:29,342 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,396 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,451 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:28:29,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:29,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:29,699 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000. blk_7660263542163941150_1028
2013-10-31 18:28:29,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:46620 dest: /127.0.0.1:54365
2013-10-31 18:28:29,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:49250 dest: /127.0.0.1:34578
2013-10-31 18:28:29,744 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7660263542163941150_1028 src: /127.0.0.1:42448 dest: /127.0.0.1:59471
2013-10-31 18:28:29,750 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42448, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7660263542163941150_1028, duration: 2932937
2013-10-31 18:28:29,750 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49250, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 5192331
2013-10-31 18:28:29,752 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,753 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46620, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0003_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7660263542163941150_1028, duration: 6923836
2013-10-31 18:28:29,753 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7660263542163941150_1028 terminating
2013-10-31 18:28:29,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,756 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7660263542163941150_1028 size 128
2013-10-31 18:28:29,756 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:29,756 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:30,811 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0003_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:28:32,395 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:34,554 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0003_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:28:34,554 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:35,435 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:36,821 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:37,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0 dst=null perm=null
2013-10-31 18:28:37,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:37,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:37,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary/_attempt_20131031182606197_0003_r_000000_0 dst=null perm=null
2013-10-31 18:28:38,476 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:38,479 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_r_000000_0 1.0% reduce > reduce
2013-10-31 18:28:38,480 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_r_000000_0 is done.
2013-10-31 18:28:38,480 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_r_000000_0 was -1
2013-10-31 18:28:38,481 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:39,824 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_r_000000_0' has completed task_20131031182606197_0003_r_000000 successfully.
2013-10-31 18:28:39,830 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0003_m_000004_0' to tip task_20131031182606197_0003_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:39,833 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0003_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:28:39,833 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0003_m_000004_0 which needs 1 slots
2013-10-31 18:28:39,833 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0003_m_000004_0 which needs 1 slots
2013-10-31 18:28:39,864 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0003/attempt_20131031182606197_0003_m_000004_0. Attempting to reuse: jvm_20131031182606197_0003_m_259930158
2013-10-31 18:28:40,026 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0003_m_259930158 given task: attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,137 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000004_0 0.0%
2013-10-31 18:28:40,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary dst=null perm=null
2013-10-31 18:28:40,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:40,164 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS from client DFSClient_attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,164 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0003_m_000004_0
2013-10-31 18:28:40,169 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2161431310787054464 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1895370450695675842 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:28:40,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3560951954507469203 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:40,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:40,171 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8381546173571133180 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:40,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0003 dst=null perm=null
2013-10-31 18:28:40,347 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:40,347 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:41,665 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data6/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:41,666 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data5/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:41,666 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data6/current/blk_1895370450695675842
2013-10-31 18:28:41,666 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data5/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:41,666 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data5/current/blk_2161431310787054464
2013-10-31 18:28:41,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data6/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:41,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data5/current/blk_3560951954507469203
2013-10-31 18:28:41,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data6/current/blk_8381546173571133180
2013-10-31 18:28:42,076 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data1/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:42,076 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data2/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:42,076 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data1/current/blk_1895370450695675842
2013-10-31 18:28:42,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data2/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:42,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data2/current/blk_2161431310787054464
2013-10-31 18:28:42,077 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data2/current/blk_8381546173571133180
2013-10-31 18:28:43,108 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0003_m_000004_0 0.0% cleanup
2013-10-31 18:28:43,111 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0003_m_000004_0 is done.
2013-10-31 18:28:43,111 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0003_m_000004_0 was -1
2013-10-31 18:28:43,112 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:43,348 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_8381546173571133180_1024 blk_2161431310787054464_1021
2013-10-31 18:28:43,348 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_3560951954507469203_1023 blk_1895370450695675842_1022 blk_2161431310787054464_1021
2013-10-31 18:28:43,954 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data4/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:43,954 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data3/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:43,954 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data4/current/blk_1895370450695675842
2013-10-31 18:28:43,955 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data3/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:43,955 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data3/current/blk_2161431310787054464
2013-10-31 18:28:43,955 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data3/current/blk_3560951954507469203
2013-10-31 18:28:44,833 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:44,834 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0003_r_000000_0
2013-10-31 18:28:45,153 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1895370450695675842_1022 file build/test/data/dfs/data/data8/current/blk_1895370450695675842 for deletion
2013-10-31 18:28:45,153 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2161431310787054464_1021 file build/test/data/dfs/data/data7/current/blk_2161431310787054464 for deletion
2013-10-31 18:28:45,153 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1895370450695675842_1022 at file build/test/data/dfs/data/data8/current/blk_1895370450695675842
2013-10-31 18:28:45,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3560951954507469203_1023 file build/test/data/dfs/data/data7/current/blk_3560951954507469203 for deletion
2013-10-31 18:28:45,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2161431310787054464_1021 at file build/test/data/dfs/data/data7/current/blk_2161431310787054464
2013-10-31 18:28:45,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8381546173571133180_1024 file build/test/data/dfs/data/data8/current/blk_8381546173571133180 for deletion
2013-10-31 18:28:45,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3560951954507469203_1023 at file build/test/data/dfs/data/data7/current/blk_3560951954507469203
2013-10-31 18:28:45,155 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8381546173571133180_1024 at file build/test/data/dfs/data/data8/current/blk_8381546173571133180
2013-10-31 18:28:45,841 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0003_m_000004_0' has completed task_20131031182606197_0003_m_000004 successfully.
2013-10-31 18:28:45,844 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0003 has completed successfully.
2013-10-31 18:28:45,844 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0003,submitTime=1383244084715,launchTime=1383244084864,firstMapTaskLaunchTime=1383244095588,firstReduceTaskLaunchTime=1383244101795,firstJobSetupTaskLaunchTime=1383244086563,firstJobCleanupTaskLaunchTime=1383244119830,finishTime=1383244125844,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E5DB2886D3A746B881D7928E706D5EE1/0203F118D1D645E186861FA7ADE890C0] test/(1/1) ...eldedpipesplatform/simple
2013-10-31 18:28:45,854 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1. blk_-2544570674502979241_1029
2013-10-31 18:28:45,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:46630 dest: /127.0.0.1:54365
2013-10-31 18:28:45,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:46348 dest: /127.0.0.1:37740
2013-10-31 18:28:45,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2544570674502979241_1029 src: /127.0.0.1:42458 dest: /127.0.0.1:59471
2013-10-31 18:28:45,870 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42458, dest: /127.0.0.1:59471, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2544570674502979241_1029, duration: 6166119
2013-10-31 18:28:45,871 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,872 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46348, dest: /127.0.0.1:37740, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2544570674502979241_1029, duration: 6363878
2013-10-31 18:28:45,872 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,874 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46630, dest: /127.0.0.1:54365, bytes: 28300, op: HDFS_WRITE, cliID: DFSClient_-598798051, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2544570674502979241_1029, duration: 7735398
2013-10-31 18:28:45,874 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,875 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2544570674502979241_1029 terminating
2013-10-31 18:28:45,878 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,879 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 from client DFSClient_-598798051
2013-10-31 18:28:45,879 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_logs/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 is closed by DFSClient_-598798051
2013-10-31 18:28:45,879 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2544570674502979241_1029 size 28300
2013-10-31 18:28:45,886 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0003_1383244084715_hadoop_%5BE5DB2886D3A746B881D7928E706D5EE1%2F0203F118D1D645E1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:45,887 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000000_0'
2013-10-31 18:28:45,888 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000004_0'
2013-10-31 18:28:45,888 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000005_0'
2013-10-31 18:28:45,890 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_r_000000_0'
2013-10-31 18:28:45,890 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:28:45,890 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:28:45,890 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000002_0'
2013-10-31 18:28:45,891 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1264182116435781743 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:28:45,891 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000001_0'
2013-10-31 18:28:45,892 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0003_m_000003_0'
2013-10-31 18:28:45,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0003 dst=null perm=null
2013-10-31 18:28:45,896 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0003_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:28:45,900 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/_temporary
2013-10-31 18:28:45,910 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:45,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:45,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:28:45,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46634, bytes: 1461, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 652217
2013-10-31 18:28:45,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple dst=null perm=null
2013-10-31 18:28:45,925 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:45,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000 dst=null perm=null
2013-10-31 18:28:45,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000 dst=null perm=null
2013-10-31 18:28:45,929 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49264, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 466646
2013-10-31 18:28:45,929 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simple
2013-10-31 18:28:45,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple dst=null perm=null
2013-10-31 18:28:45,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simple/part-00000 dst=null perm=null
2013-10-31 18:28:45,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49265, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7660263542163941150_1028, duration: 367722
2013-10-31 18:28:45,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:45,948 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt. blk_4102379777415512644_1030
2013-10-31 18:28:45,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:46637 dest: /127.0.0.1:54365
2013-10-31 18:28:45,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:42464 dest: /127.0.0.1:59471
2013-10-31 18:28:45,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4102379777415512644_1030 src: /127.0.0.1:46356 dest: /127.0.0.1:37740
2013-10-31 18:28:45,954 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46356, dest: /127.0.0.1:37740, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 1108863
2013-10-31 18:28:45,955 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,956 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42464, dest: /127.0.0.1:59471, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 2676056
2013-10-31 18:28:45,956 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,956 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,958 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46637, dest: /127.0.0.1:54365, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 4524513
2013-10-31 18:28:45,958 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4102379777415512644_1030 terminating
2013-10-31 18:28:45,958 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,961 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt from client DFSClient_-1596270109
2013-10-31 18:28:45,961 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt is closed by DFSClient_-1596270109
2013-10-31 18:28:45,961 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4102379777415512644_1030 size 19
2013-10-31 18:28:45,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:45,974 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt. blk_3135295757712174631_1031
2013-10-31 18:28:45,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:46640 dest: /127.0.0.1:54365
2013-10-31 18:28:45,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:49270 dest: /127.0.0.1:34578
2013-10-31 18:28:45,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3135295757712174631_1031 src: /127.0.0.1:46359 dest: /127.0.0.1:37740
2013-10-31 18:28:45,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46359, dest: /127.0.0.1:37740, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 1182049
2013-10-31 18:28:45,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,985 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49270, dest: /127.0.0.1:34578, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 2848975
2013-10-31 18:28:45,985 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,987 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46640, dest: /127.0.0.1:54365, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 4551829
2013-10-31 18:28:45,987 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3135295757712174631_1031 terminating
2013-10-31 18:28:45,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:45,991 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt from client DFSClient_-1596270109
2013-10-31 18:28:45,991 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:28:45,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:45,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3135295757712174631_1031 size 19
2013-10-31 18:28:46,015 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:28:46,015 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:28:46,033 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting
2013-10-31 18:28:46,033 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:28:46,033 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:28:46,033 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge"]
2013-10-31 18:28:46,034 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] parallel execution is enabled: true
2013-10-31 18:28:46,034 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting jobs: 1
2013-10-31 18:28:46,034 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] allocating threads: 1
2013-10-31 18:28:46,035 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] starting step: (1/1) ...pipesplatform/simplemerge
2013-10-31 18:28:46,041 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:28:46,042 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:28:46,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:46,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:28:46,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,066 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar. blk_-9189823900633492842_1032
2013-10-31 18:28:46,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:49272 dest: /127.0.0.1:34578
2013-10-31 18:28:46,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:46361 dest: /127.0.0.1:37740
2013-10-31 18:28:46,072 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:46645 dest: /127.0.0.1:54365
2013-10-31 18:28:46,084 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46645, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9189823900633492842_1032, duration: 8650853
2013-10-31 18:28:46,085 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,086 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,086 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46361, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9189823900633492842_1032, duration: 10349115
2013-10-31 18:28:46,087 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,088 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49272, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9189823900633492842_1032, duration: 12403428
2013-10-31 18:28:46,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9189823900633492842_1032 terminating
2013-10-31 18:28:46,091 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:46,092 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar from client DFSClient_-1596270109
2013-10-31 18:28:46,092 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:28:46,100 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar. New replication is 10
2013-10-31 18:28:46,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=null
2013-10-31 18:28:46,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,112 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:28:46,116 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:28:46,118 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:28:46,120 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:28:46,121 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:28:46,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:28:46,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:46,135 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split. New replication is 10
2013-10-31 18:28:46,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:46,143 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split. blk_-1962318321612106766_1033
2013-10-31 18:28:46,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:46646 dest: /127.0.0.1:54365
2013-10-31 18:28:46,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:46364 dest: /127.0.0.1:37740
2013-10-31 18:28:46,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:42474 dest: /127.0.0.1:59471
2013-10-31 18:28:46,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1962318321612106766_1033 src: /127.0.0.1:49278 dest: /127.0.0.1:34578
2013-10-31 18:28:46,151 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49278, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1962318321612106766_1033, duration: 746106
2013-10-31 18:28:46,152 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,153 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42474, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 1785726
2013-10-31 18:28:46,153 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,154 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46364, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1962318321612106766_1033, duration: 3207353
2013-10-31 18:28:46,154 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,155 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46646, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 4377765
2013-10-31 18:28:46,155 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,156 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-1962318321612106766_1033 terminating
2013-10-31 18:28:46,158 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,158 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split from client DFSClient_-1596270109
2013-10-31 18:28:46,158 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split is closed by DFSClient_-1596270109
2013-10-31 18:28:46,159 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,160 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1962318321612106766_1033 size 2077
2013-10-31 18:28:46,349 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-9189823900633492842_1032 to datanode(s) 127.0.0.1:59471
2013-10-31 18:28:46,349 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1264182116435781743_1027
2013-10-31 18:28:46,349 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_1264182116435781743_1027
2013-10-31 18:28:47,667 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data6/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:47,668 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data6/current/blk_1264182116435781743
2013-10-31 18:28:47,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,866 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo. blk_9217066690358023305_1034
2013-10-31 18:28:47,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:49279 dest: /127.0.0.1:34578
2013-10-31 18:28:47,870 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:46651 dest: /127.0.0.1:54365
2013-10-31 18:28:47,872 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9217066690358023305_1034 src: /127.0.0.1:42478 dest: /127.0.0.1:59471
2013-10-31 18:28:47,876 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42478, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9217066690358023305_1034, duration: 833576
2013-10-31 18:28:47,876 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,877 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,877 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46651, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9217066690358023305_1034, duration: 2602716
2013-10-31 18:28:47,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,879 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49279, dest: /127.0.0.1:34578, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9217066690358023305_1034, duration: 4456683
2013-10-31 18:28:47,880 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9217066690358023305_1034 terminating
2013-10-31 18:28:47,883 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,883 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:28:47,884 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:28:47,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9217066690358023305_1034 size 218
2013-10-31 18:28:47,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,910 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml. blk_4845321285802585100_1035
2013-10-31 18:28:47,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:49282 dest: /127.0.0.1:34578
2013-10-31 18:28:47,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:46654 dest: /127.0.0.1:54365
2013-10-31 18:28:47,915 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4845321285802585100_1035 src: /127.0.0.1:42481 dest: /127.0.0.1:59471
2013-10-31 18:28:47,924 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42481, dest: /127.0.0.1:59471, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 2326187
2013-10-31 18:28:47,924 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,925 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46654, dest: /127.0.0.1:54365, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4845321285802585100_1035, duration: 3200110
2013-10-31 18:28:47,925 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,925 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,925 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49282, dest: /127.0.0.1:34578, bytes: 28233, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4845321285802585100_1035, duration: 4149911
2013-10-31 18:28:47,926 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4845321285802585100_1035 terminating
2013-10-31 18:28:47,926 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,929 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml from client DFSClient_-1596270109
2013-10-31 18:28:47,930 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:28:47,930 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4845321285802585100_1035 size 28233
2013-10-31 18:28:47,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=null
2013-10-31 18:28:47,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42483, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 527491
2013-10-31 18:28:47,970 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0004: nMaps=6 nReduces=1 max=-1
2013-10-31 18:28:47,970 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0004 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:28:47,971 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0004 RESULT=SUCCESS
2013-10-31 18:28:47,971 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0004
2013-10-31 18:28:47,971 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0004
2013-10-31 18:28:47,973 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] submitted hadoop job: job_20131031182606197_0004
2013-10-31 18:28:47,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:47,992 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml. blk_7295626289958709819_1037
2013-10-31 18:28:47,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:49287 dest: /127.0.0.1:34578
2013-10-31 18:28:47,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:46659 dest: /127.0.0.1:54365
2013-10-31 18:28:47,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7295626289958709819_1037 src: /127.0.0.1:46377 dest: /127.0.0.1:37740
2013-10-31 18:28:47,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46377, dest: /127.0.0.1:37740, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7295626289958709819_1037, duration: 579644
2013-10-31 18:28:47,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:47,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46659, dest: /127.0.0.1:54365, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7295626289958709819_1037, duration: 1514744
2013-10-31 18:28:47,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:47,999 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49287, dest: /127.0.0.1:34578, bytes: 28298, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7295626289958709819_1037, duration: 2354262
2013-10-31 18:28:47,999 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7295626289958709819_1037 terminating
2013-10-31 18:28:48,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,002 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,003 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7295626289958709819_1037 size 28298
2013-10-31 18:28:48,078 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-9189823900633492842_1032 to 127.0.0.1:59471
2013-10-31 18:28:48,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9189823900633492842_1032 src: /127.0.0.1:42487 dest: /127.0.0.1:59471
2013-10-31 18:28:48,080 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-9189823900633492842_1032 to /127.0.0.1:59471
2013-10-31 18:28:48,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-9189823900633492842_1032 src: /127.0.0.1:42487 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:28:48,085 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9189823900633492842_1032 size 238055
2013-10-31 18:28:48,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data7/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:48,154 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data7/current/blk_1264182116435781743
2013-10-31 18:28:48,402 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml from client DFSClient_-1078423659
2013-10-31 18:28:48,403 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_conf.xml is closed by DFSClient_-1078423659
2013-10-31 18:28:48,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:28:48,415 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken. blk_-3563572431240499727_1038
2013-10-31 18:28:48,417 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:46662 dest: /127.0.0.1:54365
2013-10-31 18:28:48,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:42489 dest: /127.0.0.1:59471
2013-10-31 18:28:48,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3563572431240499727_1038 src: /127.0.0.1:49293 dest: /127.0.0.1:34578
2013-10-31 18:28:48,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49293, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 1124238
2013-10-31 18:28:48,425 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42489, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3563572431240499727_1038, duration: 2648559
2013-10-31 18:28:48,426 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,426 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46662, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3563572431240499727_1038, duration: 4800046
2013-10-31 18:28:48,428 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,429 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3563572431240499727_1038 terminating
2013-10-31 18:28:48,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3563572431240499727_1038 size 116
2013-10-31 18:28:48,431 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken from client DFSClient_-1596270109
2013-10-31 18:28:48,431 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:28:48,437 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken
2013-10-31 18:28:48,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.splitmetainfo dst=null perm=null
2013-10-31 18:28:48,442 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46665, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9217066690358023305_1034, duration: 337354
2013-10-31 18:28:48,444 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0004 = 38. Number of splits = 6
2013-10-31 18:28:48,444 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,444 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,445 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,446 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,447 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,448 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,449 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0004_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:28:48,449 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0004 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:28:48,450 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0004 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:28:48,895 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0004_m_000007_0' to tip task_20131031182606197_0004_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:48,904 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:28:48,904 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000007_0 which needs 1 slots
2013-10-31 18:28:48,905 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000007_0 which needs 1 slots
2013-10-31 18:28:48,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken dst=null perm=null
2013-10-31 18:28:48,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49295, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 348307
2013-10-31 18:28:48,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=null
2013-10-31 18:28:48,928 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46668, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1585629740, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4845321285802585100_1035, duration: 488756
2013-10-31 18:28:48,961 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:48,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=null
2013-10-31 18:28:48,992 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46386, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1585629740, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9189823900633492842_1032, duration: 1677371
2013-10-31 18:28:49,076 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0003_m_-1824933735
2013-10-31 18:28:49,083 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17001 with signal TERM. Exit code 0
2013-10-31 18:28:49,083 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_629524259
2013-10-31 18:28:49,084 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_629524259 spawned.
2013-10-31 18:28:49,088 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000007_0/taskjvm.sh
2013-10-31 18:28:49,192 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:49,192 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:49,193 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:49,193 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_-1824933735 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:49,350 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1264182116435781743_1027
2013-10-31 18:28:50,543 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_629524259 given task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:50,891 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,891 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0003_m_000004_0 not found in cache
2013-10-31 18:28:50,891 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530891
2013-10-31 18:28:50,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530892
2013-10-31 18:28:50,892 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,892 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530892
2013-10-31 18:28:50,893 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0003
2013-10-31 18:28:50,893 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0003 for user-log deletion with retainTimeStamp:1383330530893
2013-10-31 18:28:51,057 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_r_1010257680 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,064 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17258 with signal TERM. Exit code 0
2013-10-31 18:28:51,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1264182116435781743_1027 file build/test/data/dfs/data/data2/current/blk_1264182116435781743 for deletion
2013-10-31 18:28:51,078 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1264182116435781743_1027 at file build/test/data/dfs/data/data2/current/blk_1264182116435781743
2013-10-31 18:28:51,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:28:51,151 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_259930158 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,161 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group16839 with signal TERM. Exit code 0
2013-10-31 18:28:51,227 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,228 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,228 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:51,228 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_r_1010257680 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,288 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_606975538 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,298 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17052 with signal TERM. Exit code 0
2013-10-31 18:28:51,335 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,335 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,335 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:51,335 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_259930158 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:28:51,519 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,519 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,519 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:51,519 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_606975538 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,759 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_1908169258 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,769 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17096 with signal TERM. Exit code 0
2013-10-31 18:28:51,782 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0003_m_-594210753 since job job_20131031182606197_0003 is dead
2013-10-31 18:28:51,792 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17095 with signal TERM. Exit code 0
2013-10-31 18:28:51,982 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,983 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,983 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:51,983 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_1908169258 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:51,984 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:28:51,985 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:28:51,985 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:28:51,985 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0003_m_-594210753 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:28:54,008 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000007_0 0.0% setup
2013-10-31 18:28:54,012 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000007_0 is done.
2013-10-31 18:28:54,013 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000007_0 was -1
2013-10-31 18:28:54,013 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:54,909 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000007_0' has completed task_20131031182606197_0004_m_000007 successfully.
2013-10-31 18:28:54,913 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000000_0' to tip task_20131031182606197_0004_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:54,915 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000000
2013-10-31 18:28:54,915 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000001_0' to tip task_20131031182606197_0004_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:28:54,916 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000001
2013-10-31 18:28:54,918 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000002_0' to tip task_20131031182606197_0004_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:54,921 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:28:54,922 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000002
2013-10-31 18:28:54,922 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:28:54,922 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000000_0 which needs 1 slots
2013-10-31 18:28:54,922 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000003_0' to tip task_20131031182606197_0004_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:28:54,923 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000000_0 which needs 1 slots
2013-10-31 18:28:54,923 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000003
2013-10-31 18:28:54,923 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000001_0 which needs 1 slots
2013-10-31 18:28:54,923 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000001_0 which needs 1 slots
2013-10-31 18:28:54,931 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:28:54,933 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:28:54,933 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000002_0 which needs 1 slots
2013-10-31 18:28:54,934 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000002_0 which needs 1 slots
2013-10-31 18:28:54,934 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000003_0 which needs 1 slots
2013-10-31 18:28:54,935 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000003_0 which needs 1 slots
2013-10-31 18:28:54,948 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000004_0' to tip task_20131031182606197_0004_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:54,949 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000004
2013-10-31 18:28:54,949 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0004_m_000005_0' to tip task_20131031182606197_0004_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:28:54,950 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0004_m_000005
2013-10-31 18:28:54,952 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:28:54,953 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:28:54,954 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000004_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000004_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000005_0 which needs 1 slots
2013-10-31 18:28:54,954 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0004_m_000005_0 which needs 1 slots
2013-10-31 18:28:54,970 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_1328977401
2013-10-31 18:28:54,972 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_1328977401 spawned.
2013-10-31 18:28:54,973 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0004/attempt_20131031182606197_0004_m_000001_0. Attempting to reuse: jvm_20131031182606197_0004_m_629524259
2013-10-31 18:28:54,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken dst=null perm=null
2013-10-31 18:28:54,976 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000000_0/taskjvm.sh
2013-10-31 18:28:54,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004/jobToken dst=null perm=null
2013-10-31 18:28:54,979 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49302, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 248591
2013-10-31 18:28:54,981 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49303, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3563572431240499727_1038, duration: 351101
2013-10-31 18:28:54,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=null
2013-10-31 18:28:54,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.xml dst=null perm=null
2013-10-31 18:28:54,993 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42503, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-1750631584, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4845321285802585100_1035, duration: 320577
2013-10-31 18:28:54,995 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49307, bytes: 28457, op: HDFS_READ, cliID: DFSClient_-319264519, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4845321285802585100_1035, duration: 508724
2013-10-31 18:28:55,022 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:55,023 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:28:55,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=null
2013-10-31 18:28:55,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.jar dst=null perm=null
2013-10-31 18:28:55,039 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49308, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-319264519, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9189823900633492842_1032, duration: 777078
2013-10-31 18:28:55,040 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46680, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1750631584, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9189823900633492842_1032, duration: 844269
2013-10-31 18:28:55,065 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_629524259 given task: attempt_20131031182606197_0004_m_000001_0
2013-10-31 18:28:55,103 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_-461648355
2013-10-31 18:28:55,104 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_-461648355 spawned.
2013-10-31 18:28:55,105 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_895495320
2013-10-31 18:28:55,106 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_895495320 spawned.
2013-10-31 18:28:55,106 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_103233333
2013-10-31 18:28:55,107 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_103233333 spawned.
2013-10-31 18:28:55,107 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_m_593026137
2013-10-31 18:28:55,107 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000004_0/taskjvm.sh
2013-10-31 18:28:55,108 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_m_593026137 spawned.
2013-10-31 18:28:55,109 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000005_0/taskjvm.sh
2013-10-31 18:28:55,110 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000002_0/taskjvm.sh
2013-10-31 18:28:55,110 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_m_000003_0/taskjvm.sh
2013-10-31 18:28:55,808 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_1328977401 given task: attempt_20131031182606197_0004_m_000000_0
2013-10-31 18:28:56,000 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:28:56,006 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,012 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,056 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,063 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,068 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,074 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:28:56,074 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:28:56,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:56,337 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42509, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 200053
2013-10-31 18:28:56,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:28:56,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:56,525 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46685, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 218422
2013-10-31 18:28:56,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:28:56,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 174507
2013-10-31 18:28:56,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49316, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 157338
2013-10-31 18:28:57,238 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_-461648355 given task: attempt_20131031182606197_0004_m_000004_0
2013-10-31 18:28:57,288 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_103233333 given task: attempt_20131031182606197_0004_m_000002_0
2013-10-31 18:28:57,289 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_593026137 given task: attempt_20131031182606197_0004_m_000003_0
2013-10-31 18:28:57,293 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_895495320 given task: attempt_20131031182606197_0004_m_000005_0
2013-10-31 18:28:57,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:57,748 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46696, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1962318321612106766_1033, duration: 205338
2013-10-31 18:28:57,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:57,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:28:57,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:57,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 187830
2013-10-31 18:28:57,789 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42524, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 188095
2013-10-31 18:28:57,792 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49328, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1962318321612106766_1033, duration: 195804
2013-10-31 18:28:57,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004/job.split dst=null perm=null
2013-10-31 18:28:57,806 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42526, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1962318321612106766_1033, duration: 224372
2013-10-31 18:28:57,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:28:57,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:28:57,834 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46418, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 151118
2013-10-31 18:28:57,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:28:57,846 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46702, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000005_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 179100
2013-10-31 18:28:58,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42529, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0004_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 192457
2013-10-31 18:28:59,269 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:28:59,275 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000000_0 is done.
2013-10-31 18:28:59,275 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000000_0 was 57
2013-10-31 18:28:59,275 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:28:59,490 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:28:59,493 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000001_0 is done.
2013-10-31 18:28:59,493 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000001_0 was 40
2013-10-31 18:28:59,494 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:28:59,922 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:59,923 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0004_m_000007_0
2013-10-31 18:28:59,923 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0004_m_000007_0 not found in cache
2013-10-31 18:29:00,676 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:29:00,677 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000004_0 is done.
2013-10-31 18:29:00,677 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000004_0 was 6
2013-10-31 18:29:00,678 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:29:00,715 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:29:00,717 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000002_0 is done.
2013-10-31 18:29:00,717 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000002_0 was 57
2013-10-31 18:29:00,718 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:29:00,720 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:29:00,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000003_0 is done.
2013-10-31 18:29:00,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000003_0 was 40
2013-10-31 18:29:00,722 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:00,733 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:29:00,734 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000005_0 is done.
2013-10-31 18:29:00,734 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000005_0 was 6
2013-10-31 18:29:00,734 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:00,926 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000000_0' has completed task_20131031182606197_0004_m_000000 successfully.
2013-10-31 18:29:00,929 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000001_0' has completed task_20131031182606197_0004_m_000001 successfully.
2013-10-31 18:29:00,932 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0004_r_000000_0' to tip task_20131031182606197_0004_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:00,935 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:00,935 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_r_000000_0 which needs 1 slots
2013-10-31 18:29:00,935 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_r_000000_0 which needs 1 slots
2013-10-31 18:29:00,936 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000002_0' has completed task_20131031182606197_0004_m_000002 successfully.
2013-10-31 18:29:00,941 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000003_0' has completed task_20131031182606197_0004_m_000003 successfully.
2013-10-31 18:29:00,959 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000004_0' has completed task_20131031182606197_0004_m_000004 successfully.
2013-10-31 18:29:00,961 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000005_0' has completed task_20131031182606197_0004_m_000005 successfully.
2013-10-31 18:29:00,979 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0004_r_1834196118
2013-10-31 18:29:00,980 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0004_r_1834196118 spawned.
2013-10-31 18:29:00,981 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0004/attempt_20131031182606197_0004_r_000000_0/taskjvm.sh
2013-10-31 18:29:02,122 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_r_1834196118 given task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:07,871 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48371, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000000_0, duration: 13690428
2013-10-31 18:29:08,586 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy >
2013-10-31 18:29:08,997 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48371, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000001_0, duration: 13214072
2013-10-31 18:29:09,014 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40738, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000002_0, duration: 13122866
2013-10-31 18:29:09,030 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40738, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000003_0, duration: 11903053
2013-10-31 18:29:09,047 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38718, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000004_0, duration: 12396678
2013-10-31 18:29:09,062 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38718, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0004_m_000005_0, duration: 11548678
2013-10-31 18:29:09,638 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy >
2013-10-31 18:29:09,692 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy >
2013-10-31 18:29:09,883 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 204 Total time for transactions(ms): 7Number of transactions batched in Syncs: 7 Number of syncs: 134 SyncTimes(ms): 20096 8980
2013-10-31 18:29:09,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:09,943 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031182606197_0004_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:10,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:10,214 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000. blk_-1831368079888489988_1039
2013-10-31 18:29:10,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:46709 dest: /127.0.0.1:54365
2013-10-31 18:29:10,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:49339 dest: /127.0.0.1:34578
2013-10-31 18:29:10,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1831368079888489988_1039 src: /127.0.0.1:42537 dest: /127.0.0.1:59471
2013-10-31 18:29:10,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42537, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1831368079888489988_1039, duration: 2042528
2013-10-31 18:29:10,265 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,266 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49339, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1831368079888489988_1039, duration: 3544566
2013-10-31 18:29:10,266 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,267 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46709, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0004_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 4254561
2013-10-31 18:29:10,267 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1831368079888489988_1039 terminating
2013-10-31 18:29:10,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1831368079888489988_1039 size 40
2013-10-31 18:29:10,270 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:10,270 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:10,309 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0004_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:29:10,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 0.0% reduce > copy >
2013-10-31 18:29:11,634 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:12,947 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:13,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0 dst=null perm=null
2013-10-31 18:29:13,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:13,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:13,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary/_attempt_20131031182606197_0004_r_000000_0 dst=null perm=null
2013-10-31 18:29:14,674 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:14,677 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:14,680 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_r_000000_0 is done.
2013-10-31 18:29:14,680 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_r_000000_0 was -1
2013-10-31 18:29:14,680 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:15,951 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_r_000000_0' has completed task_20131031182606197_0004_r_000000 successfully.
2013-10-31 18:29:16,133 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0004_m_000006_0' to tip task_20131031182606197_0004_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:16,135 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0004_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:29:16,136 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0004_m_000006_0 which needs 1 slots
2013-10-31 18:29:16,136 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0004_m_000006_0 which needs 1 slots
2013-10-31 18:29:16,176 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0004/attempt_20131031182606197_0004_m_000006_0. Attempting to reuse: jvm_20131031182606197_0004_m_1328977401
2013-10-31 18:29:16,351 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0004_m_1328977401 given task: attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,510 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000006_0 0.0%
2013-10-31 18:29:16,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary dst=null perm=null
2013-10-31 18:29:16,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:16,529 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS from client DFSClient_attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,529 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0004_m_000006_0
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9189823900633492842 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1962318321612106766 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,535 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9217066690358023305 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:16,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:16,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4845321285802585100 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:16,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0004 dst=null perm=null
2013-10-31 18:29:16,656 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:29:19,355 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035
2013-10-31 18:29:19,355 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-1962318321612106766_1033 blk_-9189823900633492842_1032
2013-10-31 18:29:19,463 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0004_m_000006_0 0.0% cleanup
2013-10-31 18:29:19,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0004_m_000006_0 is done.
2013-10-31 18:29:19,466 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0004_m_000006_0 was -1
2013-10-31 18:29:19,466 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:19,966 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data4/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:19,966 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data3/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:19,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data4/current/blk_-9189823900633492842
2013-10-31 18:29:19,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data3/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:19,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data3/current/blk_-1962318321612106766
2013-10-31 18:29:19,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data4/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:19,968 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data3/current/blk_4845321285802585100
2013-10-31 18:29:19,968 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data4/current/blk_9217066690358023305
2013-10-31 18:29:21,136 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:21,136 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0004_r_000000_0
2013-10-31 18:29:21,165 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data7/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:21,165 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data8/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:21,166 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data7/current/blk_-9189823900633492842
2013-10-31 18:29:21,166 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data8/current/blk_-1962318321612106766
2013-10-31 18:29:22,143 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0004_m_000006_0' has completed task_20131031182606197_0004_m_000006 successfully.
2013-10-31 18:29:22,145 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0004 has completed successfully.
2013-10-31 18:29:22,146 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0004,submitTime=1383244127937,launchTime=1383244128449,firstMapTaskLaunchTime=1383244134913,firstReduceTaskLaunchTime=1383244140932,firstJobSetupTaskLaunchTime=1383244128895,firstJobCleanupTaskLaunchTime=1383244156133,finishTime=1383244162145,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=13,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[135A132A023E4325807DD05CD043A642/AC02971AC50B4DBF939A3656494373E4] merge/(1/1) ...pipesplatform/simplemerge
2013-10-31 18:29:22,152 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF. blk_4155904879908459364_1040
2013-10-31 18:29:22,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:42541 dest: /127.0.0.1:59471
2013-10-31 18:29:22,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:49345 dest: /127.0.0.1:34578
2013-10-31 18:29:22,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4155904879908459364_1040 src: /127.0.0.1:46717 dest: /127.0.0.1:54365
2013-10-31 18:29:22,173 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46717, dest: /127.0.0.1:54365, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4155904879908459364_1040, duration: 4236600
2013-10-31 18:29:22,174 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,175 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49345, dest: /127.0.0.1:34578, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4155904879908459364_1040, duration: 8378818
2013-10-31 18:29:22,175 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,177 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42541, dest: /127.0.0.1:59471, bytes: 34985, op: HDFS_WRITE, cliID: DFSClient_-1078423659, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4155904879908459364_1040, duration: 8191988
2013-10-31 18:29:22,177 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,177 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4155904879908459364_1040 terminating
2013-10-31 18:29:22,180 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,185 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF from client DFSClient_-1078423659
2013-10-31 18:29:22,185 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_logs/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF is closed by DFSClient_-1078423659
2013-10-31 18:29:22,186 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4155904879908459364_1040 size 34985
2013-10-31 18:29:22,193 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0004_1383244127937_hadoop_%5B135A132A023E4325807DD05CD043A642%2FAC02971AC50B4DBF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:29:22,193 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000000_0'
2013-10-31 18:29:22,194 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000001_0'
2013-10-31 18:29:22,194 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000006_0'
2013-10-31 18:29:22,194 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000007_0'
2013-10-31 18:29:22,195 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_r_000000_0'
2013-10-31 18:29:22,195 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:29:22,196 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:29:22,196 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000002_0'
2013-10-31 18:29:22,196 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3563572431240499727 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:29:22,196 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000003_0'
2013-10-31 18:29:22,197 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000004_0'
2013-10-31 18:29:22,198 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0004_m_000005_0'
2013-10-31 18:29:22,199 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:22,199 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0004 being deleted.
2013-10-31 18:29:22,201 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0004_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:29:22,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0004 dst=null perm=null
2013-10-31 18:29:22,206 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/_temporary
2013-10-31 18:29:22,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge dst=null perm=null
2013-10-31 18:29:22,230 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 dst=null perm=null
2013-10-31 18:29:22,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 dst=null perm=null
2013-10-31 18:29:22,236 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46719, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 310631
2013-10-31 18:29:22,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge dst=null perm=null
2013-10-31 18:29:22,256 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 dst=null perm=null
2013-10-31 18:29:22,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 dst=null perm=null
2013-10-31 18:29:22,260 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46720, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 318021
2013-10-31 18:29:22,260 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplemerge
2013-10-31 18:29:22,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge dst=null perm=null
2013-10-31 18:29:22,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemerge/part-00000 dst=null perm=null
2013-10-31 18:29:22,267 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46721, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1831368079888489988_1039, duration: 315485
2013-10-31 18:29:22,356 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035 blk_-3563572431240499727_1038
2013-10-31 18:29:22,356 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3563572431240499727_1038
2013-10-31 18:29:22,383 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:29:22,383 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:29:22,401 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:29:22,401 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:29:22,401 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach"]
2013-10-31 18:29:22,402 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:29:22,402 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:29:22,402 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:29:22,403 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...edpipesplatform/chaineach
2013-10-31 18:29:22,409 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:29:22,409 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:29:22,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:22,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:29:22,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,432 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar. blk_1525934705393393935_1041
2013-10-31 18:29:22,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:49351 dest: /127.0.0.1:34578
2013-10-31 18:29:22,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:46723 dest: /127.0.0.1:54365
2013-10-31 18:29:22,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:46441 dest: /127.0.0.1:37740
2013-10-31 18:29:22,448 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46441, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 8389941
2013-10-31 18:29:22,449 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,450 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,451 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46723, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1525934705393393935_1041, duration: 10375906
2013-10-31 18:29:22,451 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,451 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49351, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1525934705393393935_1041, duration: 12645755
2013-10-31 18:29:22,453 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1525934705393393935_1041 terminating
2013-10-31 18:29:22,455 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:22,455 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar from client DFSClient_-1596270109
2013-10-31 18:29:22,455 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:29:22,461 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar. New replication is 10
2013-10-31 18:29:22,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=null
2013-10-31 18:29:22,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,471 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:29:22,477 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:29:22,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:29:22,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:22,490 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split. New replication is 10
2013-10-31 18:29:22,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=null
2013-10-31 18:29:22,497 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split. blk_3622021248328174299_1042
2013-10-31 18:29:22,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:46442 dest: /127.0.0.1:37740
2013-10-31 18:29:22,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:49355 dest: /127.0.0.1:34578
2013-10-31 18:29:22,502 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:46727 dest: /127.0.0.1:54365
2013-10-31 18:29:22,504 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3622021248328174299_1042 src: /127.0.0.1:42554 dest: /127.0.0.1:59471
2013-10-31 18:29:22,508 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42554, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 1036100
2013-10-31 18:29:22,509 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3622021248328174299_1042, duration: 2503340
2013-10-31 18:29:22,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,512 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49355, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3622021248328174299_1042, duration: 4310238
2013-10-31 18:29:22,512 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,514 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46442, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 6324069
2013-10-31 18:29:22,514 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,514 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3622021248328174299_1042 terminating
2013-10-31 18:29:22,516 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,516 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split from client DFSClient_-1596270109
2013-10-31 18:29:22,517 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split is closed by DFSClient_-1596270109
2013-10-31 18:29:22,517 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3622021248328174299_1042 size 1403
2013-10-31 18:29:22,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data3/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:22,967 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data3/current/blk_-3563572431240499727
2013-10-31 18:29:23,679 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data5/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:23,679 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data6/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:23,679 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data5/current/blk_-9189823900633492842
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data6/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data6/current/blk_-3563572431240499727
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data6/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data6/current/blk_-1962318321612106766
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data5/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:23,680 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data6/current/blk_4845321285802585100
2013-10-31 18:29:23,681 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data5/current/blk_9217066690358023305
2013-10-31 18:29:25,357 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1525934705393393935_1041 to datanode(s) 127.0.0.1:59471
2013-10-31 18:29:25,358 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-1962318321612106766_1033 blk_-9189823900633492842_1032 blk_9217066690358023305_1034 blk_4845321285802585100_1035 blk_-3563572431240499727_1038
2013-10-31 18:29:26,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,487 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo. blk_8654515203457545904_1043
2013-10-31 18:29:26,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:46729 dest: /127.0.0.1:54365
2013-10-31 18:29:26,492 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:46447 dest: /127.0.0.1:37740
2013-10-31 18:29:26,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8654515203457545904_1043 src: /127.0.0.1:49360 dest: /127.0.0.1:34578
2013-10-31 18:29:26,497 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49360, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8654515203457545904_1043, duration: 1355307
2013-10-31 18:29:26,498 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,499 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46447, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8654515203457545904_1043, duration: 2581622
2013-10-31 18:29:26,499 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,500 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,501 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46729, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8654515203457545904_1043, duration: 4423848
2013-10-31 18:29:26,501 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8654515203457545904_1043 terminating
2013-10-31 18:29:26,504 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,505 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:29:26,505 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:29:26,506 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8654515203457545904_1043 size 156
2013-10-31 18:29:26,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,534 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml. blk_937321463194479642_1044
2013-10-31 18:29:26,535 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:42558 dest: /127.0.0.1:59471
2013-10-31 18:29:26,537 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:46733 dest: /127.0.0.1:54365
2013-10-31 18:29:26,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_937321463194479642_1044 src: /127.0.0.1:46451 dest: /127.0.0.1:37740
2013-10-31 18:29:26,543 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46451, dest: /127.0.0.1:37740, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 1033243
2013-10-31 18:29:26,543 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,544 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46733, dest: /127.0.0.1:54365, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 2808509
2013-10-31 18:29:26,545 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,546 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42558, dest: /127.0.0.1:59471, bytes: 28492, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_937321463194479642_1044, duration: 4407726
2013-10-31 18:29:26,546 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,547 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_937321463194479642_1044 terminating
2013-10-31 18:29:26,548 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,549 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml from client DFSClient_-1596270109
2013-10-31 18:29:26,549 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:29:26,550 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_937321463194479642_1044 size 28492
2013-10-31 18:29:26,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=null
2013-10-31 18:29:26,567 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46736, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 454286
2013-10-31 18:29:26,587 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0005: nMaps=4 nReduces=1 max=-1
2013-10-31 18:29:26,588 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0005 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:29:26,588 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0005
2013-10-31 18:29:26,588 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0005 RESULT=SUCCESS
2013-10-31 18:29:26,588 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0005
2013-10-31 18:29:26,590 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0005
2013-10-31 18:29:26,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,624 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml. blk_-4435351282615346343_1046
2013-10-31 18:29:26,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:49366 dest: /127.0.0.1:34578
2013-10-31 18:29:26,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:42564 dest: /127.0.0.1:59471
2013-10-31 18:29:26,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4435351282615346343_1046 src: /127.0.0.1:46456 dest: /127.0.0.1:37740
2013-10-31 18:29:26,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46456, dest: /127.0.0.1:37740, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4435351282615346343_1046, duration: 1271009
2013-10-31 18:29:26,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,632 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42564, dest: /127.0.0.1:59471, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4435351282615346343_1046, duration: 1933318
2013-10-31 18:29:26,632 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,633 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49366, dest: /127.0.0.1:34578, bytes: 28557, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4435351282615346343_1046, duration: 3224920
2013-10-31 18:29:26,634 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4435351282615346343_1046 terminating
2013-10-31 18:29:26,634 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,635 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml from client DFSClient_-79208835
2013-10-31 18:29:26,635 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_conf.xml is closed by DFSClient_-79208835
2013-10-31 18:29:26,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,637 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4435351282615346343_1046 size 28557
2013-10-31 18:29:26,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:26,650 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken. blk_-2648717928242097379_1047
2013-10-31 18:29:26,652 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:49369 dest: /127.0.0.1:34578
2013-10-31 18:29:26,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:46458 dest: /127.0.0.1:37740
2013-10-31 18:29:26,654 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2648717928242097379_1047 src: /127.0.0.1:42568 dest: /127.0.0.1:59471
2013-10-31 18:29:26,659 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42568, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 1289811
2013-10-31 18:29:26,660 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,660 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46458, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 2148703
2013-10-31 18:29:26,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,660 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49369, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2648717928242097379_1047, duration: 2586089
2013-10-31 18:29:26,660 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,661 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2648717928242097379_1047 terminating
2013-10-31 18:29:26,662 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,663 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken from client DFSClient_-1596270109
2013-10-31 18:29:26,663 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:29:26,664 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2648717928242097379_1047 size 116
2013-10-31 18:29:26,672 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken
2013-10-31 18:29:26,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.splitmetainfo dst=null perm=null
2013-10-31 18:29:26,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46743, bytes: 160, op: HDFS_READ, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8654515203457545904_1043, duration: 316074
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0005 = 1449. Number of splits = 4
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0005_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0005 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:29:26,677 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0005 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:29:27,091 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1525934705393393935_1041 to 127.0.0.1:59471
2013-10-31 18:29:27,091 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9189823900633492842_1032 file build/test/data/dfs/data/data1/current/blk_-9189823900633492842 for deletion
2013-10-31 18:29:27,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3563572431240499727_1038 file build/test/data/dfs/data/data2/current/blk_-3563572431240499727 for deletion
2013-10-31 18:29:27,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9189823900633492842_1032 at file build/test/data/dfs/data/data1/current/blk_-9189823900633492842
2013-10-31 18:29:27,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3563572431240499727_1038 at file build/test/data/dfs/data/data2/current/blk_-3563572431240499727
2013-10-31 18:29:27,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1962318321612106766_1033 file build/test/data/dfs/data/data2/current/blk_-1962318321612106766 for deletion
2013-10-31 18:29:27,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1525934705393393935_1041 src: /127.0.0.1:42570 dest: /127.0.0.1:59471
2013-10-31 18:29:27,093 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1525934705393393935_1041 to /127.0.0.1:59471
2013-10-31 18:29:27,093 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4845321285802585100_1035 file build/test/data/dfs/data/data2/current/blk_4845321285802585100 for deletion
2013-10-31 18:29:27,093 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1962318321612106766_1033 at file build/test/data/dfs/data/data2/current/blk_-1962318321612106766
2013-10-31 18:29:27,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9217066690358023305_1034 file build/test/data/dfs/data/data1/current/blk_9217066690358023305 for deletion
2013-10-31 18:29:27,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4845321285802585100_1035 at file build/test/data/dfs/data/data2/current/blk_4845321285802585100
2013-10-31 18:29:27,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9217066690358023305_1034 at file build/test/data/dfs/data/data1/current/blk_9217066690358023305
2013-10-31 18:29:27,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1525934705393393935_1041 src: /127.0.0.1:42570 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:29:27,099 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1525934705393393935_1041 size 238055
2013-10-31 18:29:27,196 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,198 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,198 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0004_m_000006_0 not found in cache
2013-10-31 18:29:27,199 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0004
2013-10-31 18:29:27,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,199 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0004 for user-log deletion with retainTimeStamp:1383330567199
2013-10-31 18:29:27,222 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_r_1834196118 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:27,232 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17989 with signal TERM. Exit code 0
2013-10-31 18:29:27,396 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:27,396 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:27,396 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:27,396 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_r_1834196118 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:27,505 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_1328977401 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:27,516 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17637 with signal TERM. Exit code 0
2013-10-31 18:29:27,698 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:27,698 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:27,699 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:27,700 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_1328977401 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:29:28,204 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0005_m_000005_0' to tip task_20131031182606197_0005_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:28,212 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:29:28,212 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000005_0 which needs 1 slots
2013-10-31 18:29:28,212 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000005_0 which needs 1 slots
2013-10-31 18:29:28,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken dst=null perm=null
2013-10-31 18:29:28,222 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46462, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 352020
2013-10-31 18:29:28,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=null
2013-10-31 18:29:28,234 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46464, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-776293736, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 440111
2013-10-31 18:29:28,257 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_-461648355 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,263 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17729 with signal TERM. Exit code 0
2013-10-31 18:29:28,265 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:28,286 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_103233333 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,295 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17764 with signal TERM. Exit code 0
2013-10-31 18:29:28,296 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_593026137 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=null
2013-10-31 18:29:28,303 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_895495320 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,305 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17763 with signal TERM. Exit code 0
2013-10-31 18:29:28,310 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49377, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-776293736, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1525934705393393935_1041, duration: 1982768
2013-10-31 18:29:28,311 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17762 with signal TERM. Exit code 0
2013-10-31 18:29:28,374 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-2042360792
2013-10-31 18:29:28,375 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-2042360792 spawned.
2013-10-31 18:29:28,376 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000005_0/taskjvm.sh
2013-10-31 18:29:28,479 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,479 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,479 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:28,480 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_-461648355 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,502 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,502 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,502 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:28,503 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_103233333 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,513 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_895495320 exited with exit code 0. Number of tasks it ran: 1
2013-10-31 18:29:28,544 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,544 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,544 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:28,545 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_593026137 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:29:28,557 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0004_m_629524259 since job job_20131031182606197_0004 is dead
2013-10-31 18:29:28,565 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group17488 with signal TERM. Exit code 0
2013-10-31 18:29:28,760 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:29:28,761 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:29:28,761 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:29:28,761 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0004_m_629524259 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:29:30,255 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-2042360792 given task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:30,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:33,711 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000005_0 0.0% setup
2013-10-31 18:29:33,714 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000005_0 is done.
2013-10-31 18:29:33,714 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000005_0 was -1
2013-10-31 18:29:33,715 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:33,951 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:29:34,219 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000005_0' has completed task_20131031182606197_0005_m_000005 successfully.
2013-10-31 18:29:34,224 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000000_0' to tip task_20131031182606197_0005_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:34,225 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000000
2013-10-31 18:29:34,227 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:34,229 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000000_0 which needs 1 slots
2013-10-31 18:29:34,229 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000001_0' to tip task_20131031182606197_0005_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:29:34,229 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000000_0 which needs 1 slots
2013-10-31 18:29:34,231 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000001
2013-10-31 18:29:34,236 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:29:34,237 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000001_0 which needs 1 slots
2013-10-31 18:29:34,237 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000001_0 which needs 1 slots
2013-10-31 18:29:34,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken dst=null perm=null
2013-10-31 18:29:34,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42580, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 387556
2013-10-31 18:29:34,256 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000002_0' to tip task_20131031182606197_0005_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:29:34,257 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000002
2013-10-31 18:29:34,259 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:29:34,259 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0005_m_000003_0' to tip task_20131031182606197_0005_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:29:34,259 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000002_0 which needs 1 slots
2013-10-31 18:29:34,259 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000002_0 which needs 1 slots
2013-10-31 18:29:34,260 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0005_m_000003
2013-10-31 18:29:34,261 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:29:34,262 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000003_0 which needs 1 slots
2013-10-31 18:29:34,262 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000003_0 which needs 1 slots
2013-10-31 18:29:34,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=null
2013-10-31 18:29:34,265 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-739234499
2013-10-31 18:29:34,266 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-739234499 spawned.
2013-10-31 18:29:34,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46473, bytes: 28716, op: HDFS_READ, cliID: DFSClient_492599419, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_937321463194479642_1044, duration: 450963
2013-10-31 18:29:34,268 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000000_0/taskjvm.sh
2013-10-31 18:29:34,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken dst=null perm=null
2013-10-31 18:29:34,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005/jobToken dst=null perm=null
2013-10-31 18:29:34,272 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46474, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2648717928242097379_1047, duration: 334997
2013-10-31 18:29:34,273 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42584, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2648717928242097379_1047, duration: 150892
2013-10-31 18:29:34,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=null
2013-10-31 18:29:34,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.xml dst=null perm=null
2013-10-31 18:29:34,279 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42587, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-514628270, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_937321463194479642_1044, duration: 191808
2013-10-31 18:29:34,279 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46762, bytes: 28716, op: HDFS_READ, cliID: DFSClient_-2110195412, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_937321463194479642_1044, duration: 193623
2013-10-31 18:29:34,293 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,293 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,309 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:29:34,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=null
2013-10-31 18:29:34,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=null
2013-10-31 18:29:34,312 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46480, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-514628270, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 796343
2013-10-31 18:29:34,312 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46481, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2110195412, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1525934705393393935_1041, duration: 781802
2013-10-31 18:29:34,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.jar dst=null perm=null
2013-10-31 18:29:34,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46765, bytes: 239915, op: HDFS_READ, cliID: DFSClient_492599419, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1525934705393393935_1041, duration: 1666072
2013-10-31 18:29:34,453 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-378893990
2013-10-31 18:29:34,453 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-378893990 spawned.
2013-10-31 18:29:34,455 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000001_0/taskjvm.sh
2013-10-31 18:29:34,477 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_-908586741
2013-10-31 18:29:34,478 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_-908586741 spawned.
2013-10-31 18:29:34,479 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000002_0/taskjvm.sh
2013-10-31 18:29:34,482 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_m_723542760
2013-10-31 18:29:34,483 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_m_723542760 spawned.
2013-10-31 18:29:34,484 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_m_000003_0/taskjvm.sh
2013-10-31 18:29:35,199 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-739234499 given task: attempt_20131031182606197_0005_m_000000_0
2013-10-31 18:29:35,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=null
2013-10-31 18:29:35,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42594, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 205708
2013-10-31 18:29:35,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:29:35,750 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49398, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 277458
2013-10-31 18:29:38,641 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:29:38,645 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000000_0 is done.
2013-10-31 18:29:38,645 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000000_0 was 54
2013-10-31 18:29:38,645 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:39,229 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:39,229 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0005_m_000005_0
2013-10-31 18:29:39,230 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0005_m_000005_0 not found in cache
2013-10-31 18:29:40,232 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000000_0' has completed task_20131031182606197_0005_m_000000 successfully.
2013-10-31 18:29:40,234 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0005_r_000000_0' to tip task_20131031182606197_0005_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:29:40,234 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:29:40,235 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_r_000000_0 which needs 1 slots
2013-10-31 18:29:40,235 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_r_000000_0 which needs 1 slots
2013-10-31 18:29:40,251 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0005_r_259930158
2013-10-31 18:29:40,252 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0005_r_259930158 spawned.
2013-10-31 18:29:40,254 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0005/attempt_20131031182606197_0005_r_000000_0/taskjvm.sh
2013-10-31 18:29:40,671 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-378893990 given task: attempt_20131031182606197_0005_m_000001_0
2013-10-31 18:29:40,817 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-908586741 given task: attempt_20131031182606197_0005_m_000002_0
2013-10-31 18:29:40,822 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_723542760 given task: attempt_20131031182606197_0005_m_000003_0
2013-10-31 18:29:41,163 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_r_259930158 given task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:41,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=null
2013-10-31 18:29:41,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42601, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3622021248328174299_1042, duration: 209985
2013-10-31 18:29:41,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:29:41,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=null
2013-10-31 18:29:41,320 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46495, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 185663
2013-10-31 18:29:41,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005/job.split dst=null perm=null
2013-10-31 18:29:41,327 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46496, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3622021248328174299_1042, duration: 115068
2013-10-31 18:29:41,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:29:41,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46497, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 205950
2013-10-31 18:29:41,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:29:41,367 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46781, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 172208
2013-10-31 18:29:41,539 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49411, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0005_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 185947
2013-10-31 18:29:44,106 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:29:44,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000001_0 is done.
2013-10-31 18:29:44,110 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000001_0 was 74
2013-10-31 18:29:44,111 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:44,250 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:29:44,253 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000002_0 is done.
2013-10-31 18:29:44,253 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000002_0 was 73
2013-10-31 18:29:44,253 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:44,258 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:29:44,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000003_0 is done.
2013-10-31 18:29:44,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000003_0 was 53
2013-10-31 18:29:44,261 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:29:46,244 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000001_0' has completed task_20131031182606197_0005_m_000001 successfully.
2013-10-31 18:29:46,269 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000002_0' has completed task_20131031182606197_0005_m_000002 successfully.
2013-10-31 18:29:46,274 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000003_0' has completed task_20131031182606197_0005_m_000003 successfully.
2013-10-31 18:29:46,825 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48450, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000000_0, duration: 8245714
2013-10-31 18:29:47,644 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:29:49,243 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:50,678 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:29:51,857 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40817, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000001_0, duration: 16777369
2013-10-31 18:29:51,875 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38797, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000002_0, duration: 12918945
2013-10-31 18:29:51,894 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43495, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0005_m_000003_0, duration: 14167513
2013-10-31 18:29:52,697 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:29:52,770 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:29:53,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:53,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:53,205 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000. blk_3433002929109606464_1048
2013-10-31 18:29:53,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:46507 dest: /127.0.0.1:37740
2013-10-31 18:29:53,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:42617 dest: /127.0.0.1:59471
2013-10-31 18:29:53,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3433002929109606464_1048 src: /127.0.0.1:46792 dest: /127.0.0.1:54365
2013-10-31 18:29:53,255 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46792, dest: /127.0.0.1:54365, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3433002929109606464_1048, duration: 2392662
2013-10-31 18:29:53,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42617, dest: /127.0.0.1:59471, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3433002929109606464_1048, duration: 3034094
2013-10-31 18:29:53,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,257 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46507, dest: /127.0.0.1:37740, bytes: 160, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0005_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3433002929109606464_1048, duration: 4018870
2013-10-31 18:29:53,257 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3433002929109606464_1048 terminating
2013-10-31 18:29:53,258 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,258 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,259 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3433002929109606464_1048 size 160
2013-10-31 18:29:53,259 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:53,259 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:53,295 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0005_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:29:53,295 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:29:54,100 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:29:54,101 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 1ms
2013-10-31 18:29:55,251 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 3 OK for attempt_20131031182606197_0005_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:29:55,252 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:29:55,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0 dst=null perm=null
2013-10-31 18:29:55,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:29:56,004 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 57
2013-10-31 18:29:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:29:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:29:56,046 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:29:56,731 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:56,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:29:56,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary/_attempt_20131031182606197_0005_r_000000_0 dst=null perm=null
2013-10-31 18:29:57,099 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:29:57,102 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:34578, blocks: 16, processing time: 2 msecs
2013-10-31 18:29:57,102 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 16 blocks took 0 msec to generate and 3 msecs for RPC and NN processing
2013-10-31 18:29:59,773 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:59,776 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_r_000000_0 1.0% reduce > reduce
2013-10-31 18:29:59,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_r_000000_0 is done.
2013-10-31 18:29:59,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_r_000000_0 was -1
2013-10-31 18:29:59,778 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:01,260 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_r_000000_0' has completed task_20131031182606197_0005_r_000000 successfully.
2013-10-31 18:30:01,266 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0005_m_000004_0' to tip task_20131031182606197_0005_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:01,268 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0005_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:30:01,268 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0005_m_000004_0 which needs 1 slots
2013-10-31 18:30:01,268 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0005_m_000004_0 which needs 1 slots
2013-10-31 18:30:01,302 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0005/attempt_20131031182606197_0005_m_000004_0. Attempting to reuse: jvm_20131031182606197_0005_m_-2042360792
2013-10-31 18:30:01,848 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0005_m_-2042360792 given task: attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:01,987 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000004_0 0.0%
2013-10-31 18:30:01,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary dst=null perm=null
2013-10-31 18:30:02,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:02,013 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS from client DFSClient_attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:02,013 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0005_m_000004_0
2013-10-31 18:30:02,019 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1525934705393393935 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3622021248328174299 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8654515203457545904 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:02,021 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_937321463194479642 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:02,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0005 dst=null perm=null
2013-10-31 18:30:04,364 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:04,364 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_3622021248328174299_1042
2013-10-31 18:30:04,956 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0005_m_000004_0 0.0% cleanup
2013-10-31 18:30:04,959 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0005_m_000004_0 is done.
2013-10-31 18:30:04,959 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0005_m_000004_0 was -1
2013-10-31 18:30:04,959 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:04,981 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data3/current/blk_937321463194479642 for deletion
2013-10-31 18:30:04,981 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data4/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:04,981 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data3/current/blk_937321463194479642
2013-10-31 18:30:04,982 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data3/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:04,982 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data4/current/blk_1525934705393393935
2013-10-31 18:30:04,982 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data4/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:04,982 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data3/current/blk_3622021248328174299
2013-10-31 18:30:04,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data4/current/blk_8654515203457545904
2013-10-31 18:30:05,693 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data6/current/blk_937321463194479642 for deletion
2013-10-31 18:30:05,693 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data5/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:05,693 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data6/current/blk_937321463194479642
2013-10-31 18:30:05,694 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data5/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:05,694 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data5/current/blk_1525934705393393935
2013-10-31 18:30:05,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data5/current/blk_3622021248328174299
2013-10-31 18:30:06,268 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:30:06,268 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0005_r_000000_0
2013-10-31 18:30:07,276 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0005_m_000004_0' has completed task_20131031182606197_0005_m_000004 successfully.
2013-10-31 18:30:07,279 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0005 has completed successfully.
2013-10-31 18:30:07,279 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0005,submitTime=1383244166556,launchTime=1383244166677,firstMapTaskLaunchTime=1383244174224,firstReduceTaskLaunchTime=1383244180233,firstJobSetupTaskLaunchTime=1383244168204,firstJobCleanupTaskLaunchTime=1383244201265,finishTime=1383244207279,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=42,reduceSlotsSeconds=19,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[F2E50B34FDA34706A90056D38CB54A5E/6010D75D4AE04CA59A4AF372B35EE05F] test/(1/1) ...edpipesplatform/chaineach
2013-10-31 18:30:07,289 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5. blk_4501780269679559994_1049
2013-10-31 18:30:07,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:46516 dest: /127.0.0.1:37740
2013-10-31 18:30:07,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:46800 dest: /127.0.0.1:54365
2013-10-31 18:30:07,295 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501780269679559994_1049 src: /127.0.0.1:49430 dest: /127.0.0.1:34578
2013-10-31 18:30:07,306 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49430, dest: /127.0.0.1:34578, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4501780269679559994_1049, duration: 7507825
2013-10-31 18:30:07,307 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,308 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46800, dest: /127.0.0.1:54365, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501780269679559994_1049, duration: 6901847
2013-10-31 18:30:07,308 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,309 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46516, dest: /127.0.0.1:37740, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-79208835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4501780269679559994_1049, duration: 7657180
2013-10-31 18:30:07,310 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,310 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4501780269679559994_1049 terminating
2013-10-31 18:30:07,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,315 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 from client DFSClient_-79208835
2013-10-31 18:30:07,315 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_logs/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 is closed by DFSClient_-79208835
2013-10-31 18:30:07,316 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4501780269679559994_1049 size 28302
2013-10-31 18:30:07,365 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:07,365 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_937321463194479642_1044 blk_1525934705393393935_1041 blk_8654515203457545904_1043 blk_3622021248328174299_1042
2013-10-31 18:30:07,533 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0005_1383244166556_hadoop_%5BF2E50B34FDA34706A90056D38CB54A5E%2F6010D75D4AE04CA5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:07,534 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000000_0'
2013-10-31 18:30:07,534 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000004_0'
2013-10-31 18:30:07,534 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000005_0'
2013-10-31 18:30:07,535 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_r_000000_0'
2013-10-31 18:30:07,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:07,536 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000003_0'
2013-10-31 18:30:07,536 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:07,537 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2648717928242097379 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:07,537 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000002_0'
2013-10-31 18:30:07,538 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0005_m_000001_0'
2013-10-31 18:30:07,541 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0005_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:07,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0005 dst=null perm=null
2013-10-31 18:30:07,545 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/_temporary
2013-10-31 18:30:07,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach dst=null perm=null
2013-10-31 18:30:07,561 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:07,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000 dst=null perm=null
2013-10-31 18:30:07,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000 dst=null perm=null
2013-10-31 18:30:07,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46803, bytes: 164, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3433002929109606464_1048, duration: 141156
2013-10-31 18:30:07,565 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chaineach
2013-10-31 18:30:07,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach dst=null perm=null
2013-10-31 18:30:07,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chaineach/part-00000 dst=null perm=null
2013-10-31 18:30:07,571 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42630, bytes: 164, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3433002929109606464_1048, duration: 113951
2013-10-31 18:30:07,580 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:30:07,581 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:30:07,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:30:07,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:30:07,596 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator"]
2013-10-31 18:30:07,597 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:30:07,597 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:30:07,597 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:30:07,597 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...tform/generatoraggregator
2013-10-31 18:30:07,600 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:30:07,600 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:30:07,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:07,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:30:07,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,615 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar. blk_3900087759881409316_1050
2013-10-31 18:30:07,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:46522 dest: /127.0.0.1:37740
2013-10-31 18:30:07,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:49435 dest: /127.0.0.1:34578
2013-10-31 18:30:07,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:46807 dest: /127.0.0.1:54365
2013-10-31 18:30:07,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46807, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3900087759881409316_1050, duration: 7178590
2013-10-31 18:30:07,629 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49435, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3900087759881409316_1050, duration: 8586537
2013-10-31 18:30:07,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,632 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46522, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 11125658
2013-10-31 18:30:07,632 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3900087759881409316_1050 terminating
2013-10-31 18:30:07,632 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,635 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar from client DFSClient_-1596270109
2013-10-31 18:30:07,635 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:30:07,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:07,639 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar. New replication is 10
2013-10-31 18:30:07,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=null
2013-10-31 18:30:07,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,649 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:30:07,655 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:07,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:30:07,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,667 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split. New replication is 10
2013-10-31 18:30:07,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=null
2013-10-31 18:30:07,674 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split. blk_2287880348402893959_1051
2013-10-31 18:30:07,675 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:46525 dest: /127.0.0.1:37740
2013-10-31 18:30:07,676 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:42635 dest: /127.0.0.1:59471
2013-10-31 18:30:07,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:46810 dest: /127.0.0.1:54365
2013-10-31 18:30:07,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2287880348402893959_1051 src: /127.0.0.1:49440 dest: /127.0.0.1:34578
2013-10-31 18:30:07,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49440, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2287880348402893959_1051, duration: 1951103
2013-10-31 18:30:07,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,684 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46810, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2287880348402893959_1051, duration: 1722221
2013-10-31 18:30:07,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,685 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,741 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42635, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2287880348402893959_1051, duration: 3159913
2013-10-31 18:30:07,741 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,742 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46525, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2287880348402893959_1051, duration: 59724856
2013-10-31 18:30:07,742 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,743 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2287880348402893959_1051 terminating
2013-10-31 18:30:07,744 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split from client DFSClient_-1596270109
2013-10-31 18:30:07,745 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split is closed by DFSClient_-1596270109
2013-10-31 18:30:07,747 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2287880348402893959_1051 size 1403
2013-10-31 18:30:07,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:07,762 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo. blk_-1936656076941190583_1052
2013-10-31 18:30:07,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:49441 dest: /127.0.0.1:34578
2013-10-31 18:30:07,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:46530 dest: /127.0.0.1:37740
2013-10-31 18:30:07,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1936656076941190583_1052 src: /127.0.0.1:46814 dest: /127.0.0.1:54365
2013-10-31 18:30:07,767 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46814, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1936656076941190583_1052, duration: 386738
2013-10-31 18:30:07,767 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46530, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1936656076941190583_1052, duration: 1714292
2013-10-31 18:30:07,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,769 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49441, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1936656076941190583_1052, duration: 2921127
2013-10-31 18:30:07,769 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:07,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1936656076941190583_1052 terminating
2013-10-31 18:30:07,770 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:30:07,771 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:30:07,771 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:07,772 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1936656076941190583_1052 size 156
2013-10-31 18:30:09,107 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data1/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:09,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data2/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:09,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data1/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:09,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data1/current/blk_1525934705393393935
2013-10-31 18:30:09,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data2/current/blk_3622021248328174299
2013-10-31 18:30:09,108 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data1/current/blk_8654515203457545904
2013-10-31 18:30:09,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_937321463194479642_1044 file build/test/data/dfs/data/data7/current/blk_937321463194479642 for deletion
2013-10-31 18:30:09,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1525934705393393935_1041 file build/test/data/dfs/data/data8/current/blk_1525934705393393935 for deletion
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3622021248328174299_1042 file build/test/data/dfs/data/data7/current/blk_3622021248328174299 for deletion
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8654515203457545904_1043 file build/test/data/dfs/data/data8/current/blk_8654515203457545904 for deletion
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1525934705393393935_1041 at file build/test/data/dfs/data/data8/current/blk_1525934705393393935
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_937321463194479642_1044 at file build/test/data/dfs/data/data7/current/blk_937321463194479642
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8654515203457545904_1043 at file build/test/data/dfs/data/data8/current/blk_8654515203457545904
2013-10-31 18:30:09,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3622021248328174299_1042 at file build/test/data/dfs/data/data7/current/blk_3622021248328174299
2013-10-31 18:30:10,366 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3900087759881409316_1050 to datanode(s) 127.0.0.1:59471
2013-10-31 18:30:10,366 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-2648717928242097379_1047
2013-10-31 18:30:10,366 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-2648717928242097379_1047
2013-10-31 18:30:10,657 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 280 Total time for transactions(ms): 8Number of transactions batched in Syncs: 11 Number of syncs: 191 SyncTimes(ms): 28762 9436
2013-10-31 18:30:10,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,678 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml. blk_-2472956342887107208_1053
2013-10-31 18:30:10,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:49446 dest: /127.0.0.1:34578
2013-10-31 18:30:10,682 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:46535 dest: /127.0.0.1:37740
2013-10-31 18:30:10,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2472956342887107208_1053 src: /127.0.0.1:42645 dest: /127.0.0.1:59471
2013-10-31 18:30:10,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42645, dest: /127.0.0.1:59471, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 1039614
2013-10-31 18:30:10,688 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,690 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46535, dest: /127.0.0.1:37740, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 2533766
2013-10-31 18:30:10,690 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,691 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49446, dest: /127.0.0.1:34578, bytes: 28318, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2472956342887107208_1053, duration: 4444030
2013-10-31 18:30:10,692 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,692 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2472956342887107208_1053 terminating
2013-10-31 18:30:10,694 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml from client DFSClient_-1596270109
2013-10-31 18:30:10,695 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:30:10,695 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2472956342887107208_1053 size 28318
2013-10-31 18:30:10,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=null
2013-10-31 18:30:10,711 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42647, bytes: 28542, op: HDFS_READ, cliID: DFSClient_592994435, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 474426
2013-10-31 18:30:10,730 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0006: nMaps=4 nReduces=1 max=-1
2013-10-31 18:30:10,731 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0006 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:30:10,731 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0006
2013-10-31 18:30:10,731 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0006 RESULT=SUCCESS
2013-10-31 18:30:10,731 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0006
2013-10-31 18:30:10,733 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0006
2013-10-31 18:30:10,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,770 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml. blk_-3726674750765888319_1055
2013-10-31 18:30:10,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:46539 dest: /127.0.0.1:37740
2013-10-31 18:30:10,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:49452 dest: /127.0.0.1:34578
2013-10-31 18:30:10,775 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3726674750765888319_1055 src: /127.0.0.1:46824 dest: /127.0.0.1:54365
2013-10-31 18:30:10,783 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46824, dest: /127.0.0.1:54365, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3726674750765888319_1055, duration: 4753535
2013-10-31 18:30:10,783 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,784 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49452, dest: /127.0.0.1:34578, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3726674750765888319_1055, duration: 5543458
2013-10-31 18:30:10,784 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,785 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46539, dest: /127.0.0.1:37740, bytes: 28383, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3726674750765888319_1055, duration: 6410008
2013-10-31 18:30:10,785 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3726674750765888319_1055 terminating
2013-10-31 18:30:10,787 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,787 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml from client DFSClient_592994435
2013-10-31 18:30:10,788 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_conf.xml is closed by DFSClient_592994435
2013-10-31 18:30:10,788 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,789 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3726674750765888319_1055 size 28383
2013-10-31 18:30:10,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:10,801 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken. blk_1426554221262928588_1056
2013-10-31 18:30:10,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:42651 dest: /127.0.0.1:59471
2013-10-31 18:30:10,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:46826 dest: /127.0.0.1:54365
2013-10-31 18:30:10,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1426554221262928588_1056 src: /127.0.0.1:49456 dest: /127.0.0.1:34578
2013-10-31 18:30:10,810 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49456, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1426554221262928588_1056, duration: 1284876
2013-10-31 18:30:10,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,812 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46826, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1426554221262928588_1056, duration: 2959070
2013-10-31 18:30:10,812 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,812 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,814 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42651, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 4846046
2013-10-31 18:30:10,814 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1426554221262928588_1056 terminating
2013-10-31 18:30:10,817 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,817 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken from client DFSClient_-1596270109
2013-10-31 18:30:10,818 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:30:10,818 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1426554221262928588_1056 size 116
2013-10-31 18:30:10,821 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken
2013-10-31 18:30:10,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.splitmetainfo dst=null perm=null
2013-10-31 18:30:10,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49457, bytes: 160, op: HDFS_READ, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1936656076941190583_1052, duration: 296264
2013-10-31 18:30:10,827 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0006 = 1449. Number of splits = 4
2013-10-31 18:30:10,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0006_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:10,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0006 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:30:10,831 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0006 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:30:10,982 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3900087759881409316_1050 to 127.0.0.1:59471
2013-10-31 18:30:10,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3900087759881409316_1050 src: /127.0.0.1:42655 dest: /127.0.0.1:59471
2013-10-31 18:30:10,985 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3900087759881409316_1050 to /127.0.0.1:59471
2013-10-31 18:30:10,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3900087759881409316_1050 src: /127.0.0.1:42655 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:30:10,991 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3900087759881409316_1050 size 238055
2013-10-31 18:30:11,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data6/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:11,695 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data6/current/blk_-2648717928242097379
2013-10-31 18:30:12,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data7/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:12,182 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data7/current/blk_-2648717928242097379
2013-10-31 18:30:12,536 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,536 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0005_m_000004_0 not found in cache
2013-10-31 18:30:12,537 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612537
2013-10-31 18:30:12,537 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612537
2013-10-31 18:30:12,538 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,538 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0005
2013-10-31 18:30:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612539
2013-10-31 18:30:12,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0005 for user-log deletion with retainTimeStamp:1383330612539
2013-10-31 18:30:12,996 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-2042360792 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,007 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18300 with signal TERM. Exit code 0
2013-10-31 18:30:13,204 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-378893990 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,206 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,206 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,206 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:13,206 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-2042360792 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:30:13,214 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18490 with signal TERM. Exit code 0
2013-10-31 18:30:13,332 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-908586741 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,337 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18525 with signal TERM. Exit code 0
2013-10-31 18:30:13,347 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_723542760 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,351 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18526 with signal TERM. Exit code 0
2013-10-31 18:30:13,367 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-2648717928242097379_1047
2013-10-31 18:30:13,416 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,416 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,416 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:13,417 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-378893990 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,529 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,530 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,530 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:13,530 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-908586741 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,544 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0006_m_000005_0' to tip task_20131031182606197_0006_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:13,547 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:13,549 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:13,549 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:13,550 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_723542760 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:13,551 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:30:13,551 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000005_0 which needs 1 slots
2013-10-31 18:30:13,551 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000005_0 which needs 1 slots
2013-10-31 18:30:13,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken dst=null perm=null
2013-10-31 18:30:13,557 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46831, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1426554221262928588_1056, duration: 179561
2013-10-31 18:30:13,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=null
2013-10-31 18:30:13,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46550, bytes: 28542, op: HDFS_READ, cliID: DFSClient_1909659099, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 435826
2013-10-31 18:30:13,586 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:13,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=null
2013-10-31 18:30:13,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46551, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1909659099, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 1362767
2013-10-31 18:30:13,717 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_-740270901
2013-10-31 18:30:13,718 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_-740270901 spawned.
2013-10-31 18:30:13,720 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000005_0/taskjvm.sh
2013-10-31 18:30:13,745 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_m_-739234499 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,755 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18411 with signal TERM. Exit code 0
2013-10-31 18:30:13,817 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0005_r_259930158 since job job_20131031182606197_0005 is dead
2013-10-31 18:30:13,827 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group18599 with signal TERM. Exit code 0
2013-10-31 18:30:14,000 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:14,000 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:14,000 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:14,000 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_r_259930158 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:14,001 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:14,001 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:14,002 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:14,002 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0005_m_-739234499 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:15,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2648717928242097379_1047 file build/test/data/dfs/data/data1/current/blk_-2648717928242097379 for deletion
2013-10-31 18:30:15,110 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2648717928242097379_1047 at file build/test/data/dfs/data/data1/current/blk_-2648717928242097379
2013-10-31 18:30:18,064 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-740270901 given task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:18,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:21,707 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000005_0 0.0% setup
2013-10-31 18:30:21,710 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000005_0 is done.
2013-10-31 18:30:21,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000005_0 was -1
2013-10-31 18:30:21,711 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:22,562 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000005_0' has completed task_20131031182606197_0006_m_000005 successfully.
2013-10-31 18:30:22,566 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000000_0' to tip task_20131031182606197_0006_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:22,567 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000000
2013-10-31 18:30:22,569 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:30:22,569 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000000_0 which needs 1 slots
2013-10-31 18:30:22,569 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000000_0 which needs 1 slots
2013-10-31 18:30:22,591 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000001_0' to tip task_20131031182606197_0006_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:30:22,593 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000001
2013-10-31 18:30:22,595 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:30:22,595 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000001_0 which needs 1 slots
2013-10-31 18:30:22,595 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000002_0' to tip task_20131031182606197_0006_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:30:22,595 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000001_0 which needs 1 slots
2013-10-31 18:30:22,596 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000002
2013-10-31 18:30:22,597 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:30:22,597 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000002_0 which needs 1 slots
2013-10-31 18:30:22,597 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000002_0 which needs 1 slots
2013-10-31 18:30:22,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken dst=null perm=null
2013-10-31 18:30:22,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken dst=null perm=null
2013-10-31 18:30:22,603 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_95840884
2013-10-31 18:30:22,604 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_95840884 spawned.
2013-10-31 18:30:22,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42663, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 148999
2013-10-31 18:30:22,606 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000000_0/taskjvm.sh
2013-10-31 18:30:22,607 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49467, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1426554221262928588_1056, duration: 114387
2013-10-31 18:30:22,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=null
2013-10-31 18:30:22,619 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46557, bytes: 28542, op: HDFS_READ, cliID: DFSClient_-1113497225, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 298525
2013-10-31 18:30:22,647 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:22,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=null
2013-10-31 18:30:22,683 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46841, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1113497225, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3900087759881409316_1050, duration: 1684079
2013-10-31 18:30:22,783 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_941089074
2013-10-31 18:30:22,784 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_941089074 spawned.
2013-10-31 18:30:22,785 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000001_0/taskjvm.sh
2013-10-31 18:30:22,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=null
2013-10-31 18:30:23,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42669, bytes: 28542, op: HDFS_READ, cliID: DFSClient_1180319444, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2472956342887107208_1053, duration: 440384
2013-10-31 18:30:23,286 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:23,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=null
2013-10-31 18:30:23,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49473, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1180319444, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3900087759881409316_1050, duration: 1526216
2013-10-31 18:30:23,384 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_-888949500
2013-10-31 18:30:23,384 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_-888949500 spawned.
2013-10-31 18:30:23,385 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000002_0/taskjvm.sh
2013-10-31 18:30:24,303 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_95840884 given task: attempt_20131031182606197_0006_m_000000_0
2013-10-31 18:30:24,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=null
2013-10-31 18:30:24,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49476, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2287880348402893959_1051, duration: 386736
2013-10-31 18:30:24,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:30:24,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46848, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 263217
2013-10-31 18:30:25,565 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0006_m_000003_0' to tip task_20131031182606197_0006_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:30:25,566 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0006_m_000003
2013-10-31 18:30:25,568 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:30:25,569 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000003_0 which needs 1 slots
2013-10-31 18:30:25,569 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000003_0 which needs 1 slots
2013-10-31 18:30:25,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006/jobToken dst=null perm=null
2013-10-31 18:30:25,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42675, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1426554221262928588_1056, duration: 322760
2013-10-31 18:30:25,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.xml dst=null perm=null
2013-10-31 18:30:25,591 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46568, bytes: 28542, op: HDFS_READ, cliID: DFSClient_889025810, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2472956342887107208_1053, duration: 476710
2013-10-31 18:30:25,624 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:25,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.jar dst=null perm=null
2013-10-31 18:30:25,653 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46569, bytes: 239915, op: HDFS_READ, cliID: DFSClient_889025810, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3900087759881409316_1050, duration: 1597480
2013-10-31 18:30:27,569 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:27,570 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0006_m_000005_0
2013-10-31 18:30:27,570 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0006_m_000005_0 not found in cache
2013-10-31 18:30:27,725 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:30:27,729 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000000_0 is done.
2013-10-31 18:30:27,729 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000000_0 was 54
2013-10-31 18:30:27,729 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:27,860 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_m_1952810705
2013-10-31 18:30:27,861 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_m_1952810705 spawned.
2013-10-31 18:30:27,862 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_m_000003_0/taskjvm.sh
2013-10-31 18:30:28,573 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000000_0' has completed task_20131031182606197_0006_m_000000 successfully.
2013-10-31 18:30:28,630 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_941089074 given task: attempt_20131031182606197_0006_m_000001_0
2013-10-31 18:30:28,640 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-888949500 given task: attempt_20131031182606197_0006_m_000002_0
2013-10-31 18:30:28,827 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0006_r_000000_0' to tip task_20131031182606197_0006_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:28,829 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:30:28,829 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_r_000000_0 which needs 1 slots
2013-10-31 18:30:28,829 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_r_000000_0 which needs 1 slots
2013-10-31 18:30:28,862 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0006_r_-1824933735
2013-10-31 18:30:28,863 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0006_r_-1824933735 spawned.
2013-10-31 18:30:28,864 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0006/attempt_20131031182606197_0006_r_000000_0/taskjvm.sh
2013-10-31 18:30:29,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=null
2013-10-31 18:30:29,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=null
2013-10-31 18:30:29,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42683, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2287880348402893959_1051, duration: 176492
2013-10-31 18:30:29,157 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46575, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2287880348402893959_1051, duration: 147269
2013-10-31 18:30:29,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:30:29,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:30:29,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46576, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 176343
2013-10-31 18:30:29,442 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49490, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 195913
2013-10-31 18:30:29,633 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_1952810705 given task: attempt_20131031182606197_0006_m_000003_0
2013-10-31 18:30:29,750 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_r_-1824933735 given task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:30,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006/job.split dst=null perm=null
2013-10-31 18:30:30,138 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46865, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2287880348402893959_1051, duration: 133965
2013-10-31 18:30:30,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:30:30,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49495, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0006_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 157402
2013-10-31 18:30:32,084 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:30:32,087 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:30:32,089 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000001_0 is done.
2013-10-31 18:30:32,090 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000001_0 was 74
2013-10-31 18:30:32,090 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:32,090 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000002_0 is done.
2013-10-31 18:30:32,091 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000002_0 was 73
2013-10-31 18:30:32,091 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:33,068 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:30:33,071 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000003_0 is done.
2013-10-31 18:30:33,072 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000003_0 was 53
2013-10-31 18:30:33,072 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:34,575 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000003_0' has completed task_20131031182606197_0006_m_000003 successfully.
2013-10-31 18:30:34,837 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000002_0' has completed task_20131031182606197_0006_m_000002 successfully.
2013-10-31 18:30:34,840 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000001_0' has completed task_20131031182606197_0006_m_000001 successfully.
2013-10-31 18:30:35,431 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48536, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000000_0, duration: 9819604
2013-10-31 18:30:36,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:30:36,963 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4839348806796864519_1019
2013-10-31 18:30:37,838 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:30:39,298 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:30:40,467 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43579, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000003_0, duration: 14509805
2013-10-31 18:30:40,485 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:40904, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000002_0, duration: 12866345
2013-10-31 18:30:40,502 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38884, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0006_m_000001_0, duration: 12524880
2013-10-31 18:30:41,303 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:30:41,356 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:30:41,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:41,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:41,568 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000. blk_-5512389547783664916_1057
2013-10-31 18:30:41,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:46594 dest: /127.0.0.1:37740
2013-10-31 18:30:41,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:46878 dest: /127.0.0.1:54365
2013-10-31 18:30:41,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5512389547783664916_1057 src: /127.0.0.1:42705 dest: /127.0.0.1:59471
2013-10-31 18:30:41,598 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42705, dest: /127.0.0.1:59471, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5512389547783664916_1057, duration: 2334425
2013-10-31 18:30:41,600 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,605 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46878, dest: /127.0.0.1:54365, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5512389547783664916_1057, duration: 9004054
2013-10-31 18:30:41,606 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,607 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46594, dest: /127.0.0.1:37740, bytes: 1376, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0006_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 10523556
2013-10-31 18:30:41,607 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5512389547783664916_1057 terminating
2013-10-31 18:30:41,608 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,611 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:41,611 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:41,611 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5512389547783664916_1057 size 1376
2013-10-31 18:30:41,657 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0006_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:30:41,658 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:30:43,846 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 3 OK for attempt_20131031182606197_0006_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:30:43,847 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:44,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0 dst=null perm=null
2013-10-31 18:30:44,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:44,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:45,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary/_attempt_20131031182606197_0006_r_000000_0 dst=null perm=null
2013-10-31 18:30:45,352 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 18:30:45,354 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_r_000000_0 1.0% reduce > reduce
2013-10-31 18:30:45,356 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_r_000000_0 is done.
2013-10-31 18:30:45,356 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_r_000000_0 was -1
2013-10-31 18:30:45,356 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:46,851 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_r_000000_0' has completed task_20131031182606197_0006_r_000000 successfully.
2013-10-31 18:30:46,856 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0006_m_000004_0' to tip task_20131031182606197_0006_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:46,859 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0006_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:30:46,859 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0006_m_000004_0 which needs 1 slots
2013-10-31 18:30:46,859 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0006_m_000004_0 which needs 1 slots
2013-10-31 18:30:46,900 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0006/attempt_20131031182606197_0006_m_000004_0. Attempting to reuse: jvm_20131031182606197_0006_m_-740270901
2013-10-31 18:30:47,796 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0006_m_-740270901 given task: attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,900 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000004_0 0.0%
2013-10-31 18:30:47,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary dst=null perm=null
2013-10-31 18:30:47,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:47,921 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS from client DFSClient_attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,921 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0006_m_000004_0
2013-10-31 18:30:47,926 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,926 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,926 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,927 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3900087759881409316 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,927 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,927 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,927 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,928 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2287880348402893959 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,928 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:47,928 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,928 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1936656076941190583 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:30:47,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:47,929 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2472956342887107208 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:47,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0006 dst=null perm=null
2013-10-31 18:30:49,373 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053 blk_-1936656076941190583_1052
2013-10-31 18:30:49,373 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-1936656076941190583_1052
2013-10-31 18:30:49,996 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data4/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:49,996 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data3/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:49,996 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data4/current/blk_-1936656076941190583
2013-10-31 18:30:49,997 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data4/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:49,997 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data3/current/blk_2287880348402893959
2013-10-31 18:30:49,997 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data4/current/blk_3900087759881409316
2013-10-31 18:30:50,871 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0006_m_000004_0 0.0% cleanup
2013-10-31 18:30:50,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0006_m_000004_0 is done.
2013-10-31 18:30:50,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0006_m_000004_0 was -1
2013-10-31 18:30:50,874 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:30:51,122 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data2/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:51,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data1/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:51,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data2/current/blk_-2472956342887107208
2013-10-31 18:30:51,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data2/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:51,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data2/current/blk_2287880348402893959
2013-10-31 18:30:51,123 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data1/current/blk_-1936656076941190583
2013-10-31 18:30:51,124 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data1/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:51,127 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data1/current/blk_3900087759881409316
2013-10-31 18:30:51,859 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:51,860 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0006_r_000000_0
2013-10-31 18:30:52,374 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053 blk_-1936656076941190583_1052
2013-10-31 18:30:52,374 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_2287880348402893959_1051 blk_3900087759881409316_1050 blk_-2472956342887107208_1053
2013-10-31 18:30:52,867 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0006_m_000004_0' has completed task_20131031182606197_0006_m_000004 successfully.
2013-10-31 18:30:53,709 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data6/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:53,709 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data5/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:53,710 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data6/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:54,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2472956342887107208_1053 file build/test/data/dfs/data/data7/current/blk_-2472956342887107208 for deletion
2013-10-31 18:30:54,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1936656076941190583_1052 file build/test/data/dfs/data/data8/current/blk_-1936656076941190583 for deletion
2013-10-31 18:30:54,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2287880348402893959_1051 file build/test/data/dfs/data/data7/current/blk_2287880348402893959 for deletion
2013-10-31 18:30:54,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3900087759881409316_1050 file build/test/data/dfs/data/data8/current/blk_3900087759881409316 for deletion
2013-10-31 18:30:55,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1936656076941190583_1052 at file build/test/data/dfs/data/data8/current/blk_-1936656076941190583
2013-10-31 18:30:55,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data6/current/blk_-2472956342887107208
2013-10-31 18:30:55,740 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data8/current/blk_3900087759881409316
2013-10-31 18:30:55,741 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3900087759881409316_1050 at file build/test/data/dfs/data/data6/current/blk_3900087759881409316
2013-10-31 18:30:55,746 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0006 has completed successfully.
2013-10-31 18:30:55,747 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0006,submitTime=1383244210700,launchTime=1383244210830,firstMapTaskLaunchTime=1383244222566,firstReduceTaskLaunchTime=1383244228827,firstJobSetupTaskLaunchTime=1383244213544,firstJobCleanupTaskLaunchTime=1383244246856,finishTime=1383244255746,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[451BE7ACA61247E4A72FF8F7D978C016/ED9389E3934B4561A8B31ED9C6E7A142] test/(1/1) ...tform/generatoraggregator
2013-10-31 18:30:55,760 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561. blk_-8363873052003505238_1058
2013-10-31 18:30:55,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:49513 dest: /127.0.0.1:34578
2013-10-31 18:30:55,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:42711 dest: /127.0.0.1:59471
2013-10-31 18:30:55,766 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8363873052003505238_1058 src: /127.0.0.1:46603 dest: /127.0.0.1:37740
2013-10-31 18:30:55,776 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46603, dest: /127.0.0.1:37740, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8363873052003505238_1058, duration: 6457087
2013-10-31 18:30:55,777 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,778 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42711, dest: /127.0.0.1:59471, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8363873052003505238_1058, duration: 5284250
2013-10-31 18:30:55,778 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,779 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49513, dest: /127.0.0.1:34578, bytes: 28323, op: HDFS_WRITE, cliID: DFSClient_592994435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8363873052003505238_1058, duration: 9614698
2013-10-31 18:30:55,780 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,780 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8363873052003505238_1058 terminating
2013-10-31 18:30:55,784 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,784 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8363873052003505238_1058 size 28323
2013-10-31 18:30:55,785 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 from client DFSClient_592994435
2013-10-31 18:30:55,785 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_logs/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 is closed by DFSClient_592994435
2013-10-31 18:30:55,790 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data5/current/blk_2287880348402893959
2013-10-31 18:30:55,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2472956342887107208_1053 at file build/test/data/dfs/data/data7/current/blk_-2472956342887107208
2013-10-31 18:30:55,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2287880348402893959_1051 at file build/test/data/dfs/data/data7/current/blk_2287880348402893959
2013-10-31 18:30:55,801 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0006_1383244210700_hadoop_%5B451BE7ACA61247E4A72FF8F7D978C016%2FED9389E3934B4561 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:55,802 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000000_0'
2013-10-31 18:30:55,802 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000004_0'
2013-10-31 18:30:55,803 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000005_0'
2013-10-31 18:30:55,804 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_r_000000_0'
2013-10-31 18:30:55,804 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:30:55,804 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:30:55,804 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000001_0'
2013-10-31 18:30:55,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1426554221262928588 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:30:55,808 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0006_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:30:55,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0006 dst=null perm=null
2013-10-31 18:30:55,813 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/_temporary
2013-10-31 18:30:55,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator dst=null perm=null
2013-10-31 18:30:55,835 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:55,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000 dst=null perm=null
2013-10-31 18:30:55,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000 dst=null perm=null
2013-10-31 18:30:55,839 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46605, bytes: 1388, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 503896
2013-10-31 18:30:55,840 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/generatoraggregator
2013-10-31 18:30:55,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator dst=null perm=null
2013-10-31 18:30:55,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/generatoraggregator/part-00000 dst=null perm=null
2013-10-31 18:30:55,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46606, bytes: 1388, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5512389547783664916_1057, duration: 542499
2013-10-31 18:30:55,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:55,855 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000003_0'
2013-10-31 18:30:55,856 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt. blk_-249196459070022847_1059
2013-10-31 18:30:55,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:46607 dest: /127.0.0.1:37740
2013-10-31 18:30:55,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:42717 dest: /127.0.0.1:59471
2013-10-31 18:30:55,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-249196459070022847_1059 src: /127.0.0.1:46892 dest: /127.0.0.1:54365
2013-10-31 18:30:55,861 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46892, dest: /127.0.0.1:54365, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-249196459070022847_1059, duration: 1160196
2013-10-31 18:30:55,862 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,862 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42717, dest: /127.0.0.1:59471, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-249196459070022847_1059, duration: 1669468
2013-10-31 18:30:55,862 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,862 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,863 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46607, dest: /127.0.0.1:37740, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-249196459070022847_1059, duration: 2138552
2013-10-31 18:30:55,864 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,864 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-249196459070022847_1059 terminating
2013-10-31 18:30:55,866 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt from client DFSClient_-1596270109
2013-10-31 18:30:55,867 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt is closed by DFSClient_-1596270109
2013-10-31 18:30:55,867 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-249196459070022847_1059 size 15
2013-10-31 18:30:55,867 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0006_m_000002_0'
2013-10-31 18:30:55,888 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:30:55,889 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:30:55,921 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting
2013-10-31 18:30:55,921 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:30:55,922 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:30:55,922 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt"]
2013-10-31 18:30:55,922 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree"]
2013-10-31 18:30:55,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] parallel execution is enabled: true
2013-10-31 18:30:55,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] starting jobs: 1
2013-10-31 18:30:55,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merge] allocating threads: 1
2013-10-31 18:30:55,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] starting step: (1/1) ...platform/simplemergethree
2013-10-31 18:30:55,928 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:30:55,928 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:30:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:30:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:30:56,046 INFO metrics.MetricsSaver (?:flush(?)) - Discard 36 records
2013-10-31 18:30:56,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:30:56,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:30:56,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,174 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar. blk_7334543370624894983_1060
2013-10-31 18:30:56,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:46610 dest: /127.0.0.1:37740
2013-10-31 18:30:56,177 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:42720 dest: /127.0.0.1:59471
2013-10-31 18:30:56,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:46895 dest: /127.0.0.1:54365
2013-10-31 18:30:56,190 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46895, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7334543370624894983_1060, duration: 4722778
2013-10-31 18:30:56,190 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,191 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42720, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7334543370624894983_1060, duration: 6234896
2013-10-31 18:30:56,192 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46610, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 8039710
2013-10-31 18:30:56,193 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7334543370624894983_1060 terminating
2013-10-31 18:30:56,195 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar from client DFSClient_-1596270109
2013-10-31 18:30:56,196 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:30:56,196 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,198 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:30:56,201 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar. New replication is 10
2013-10-31 18:30:56,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=null
2013-10-31 18:30:56,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,211 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:30:56,218 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:30:56,222 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 18:30:56,225 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:30:56,229 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:30:56,232 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 18:30:56,235 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:30:56,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:30:56,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,249 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split. New replication is 10
2013-10-31 18:30:56,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:30:56,256 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split. blk_2855333912159915853_1061
2013-10-31 18:30:56,258 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:46896 dest: /127.0.0.1:54365
2013-10-31 18:30:56,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:42723 dest: /127.0.0.1:59471
2013-10-31 18:30:56,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:49527 dest: /127.0.0.1:34578
2013-10-31 18:30:56,263 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2855333912159915853_1061 src: /127.0.0.1:46616 dest: /127.0.0.1:37740
2013-10-31 18:30:56,269 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46616, dest: /127.0.0.1:37740, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2855333912159915853_1061, duration: 1254357
2013-10-31 18:30:56,270 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,271 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49527, dest: /127.0.0.1:34578, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 2559922
2013-10-31 18:30:56,271 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,272 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,273 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42723, dest: /127.0.0.1:59471, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2855333912159915853_1061, duration: 4486291
2013-10-31 18:30:56,273 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,274 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46896, dest: /127.0.0.1:54365, bytes: 3133, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 5933692
2013-10-31 18:30:56,275 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,275 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2855333912159915853_1061 terminating
2013-10-31 18:30:56,277 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,278 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split from client DFSClient_-1596270109
2013-10-31 18:30:56,278 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split is closed by DFSClient_-1596270109
2013-10-31 18:30:56,279 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2855333912159915853_1061 size 3133
2013-10-31 18:30:56,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,298 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo. blk_-1355772319426900150_1062
2013-10-31 18:30:56,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:46900 dest: /127.0.0.1:54365
2013-10-31 18:30:56,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:42727 dest: /127.0.0.1:59471
2013-10-31 18:30:56,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1355772319426900150_1062 src: /127.0.0.1:46619 dest: /127.0.0.1:37740
2013-10-31 18:30:56,307 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46619, dest: /127.0.0.1:37740, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1355772319426900150_1062, duration: 945870
2013-10-31 18:30:56,307 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,308 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42727, dest: /127.0.0.1:59471, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1355772319426900150_1062, duration: 2495784
2013-10-31 18:30:56,309 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,310 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46900, dest: /127.0.0.1:54365, bytes: 323, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1355772319426900150_1062, duration: 4254730
2013-10-31 18:30:56,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1355772319426900150_1062 terminating
2013-10-31 18:30:56,313 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,313 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:30:56,314 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:30:56,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,315 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1355772319426900150_1062 size 323
2013-10-31 18:30:56,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,522 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml. blk_6179045511188231419_1063
2013-10-31 18:30:56,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:49532 dest: /127.0.0.1:34578
2013-10-31 18:30:56,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:42730 dest: /127.0.0.1:59471
2013-10-31 18:30:56,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6179045511188231419_1063 src: /127.0.0.1:46905 dest: /127.0.0.1:54365
2013-10-31 18:30:56,532 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:54365, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 2138085
2013-10-31 18:30:56,532 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,533 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42730, dest: /127.0.0.1:59471, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6179045511188231419_1063, duration: 2935964
2013-10-31 18:30:56,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,533 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49532, dest: /127.0.0.1:34578, bytes: 29347, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 3755176
2013-10-31 18:30:56,533 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,534 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6179045511188231419_1063 terminating
2013-10-31 18:30:56,537 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml from client DFSClient_-1596270109
2013-10-31 18:30:56,537 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:30:56,537 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,538 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6179045511188231419_1063 size 29347
2013-10-31 18:30:56,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=null
2013-10-31 18:30:56,552 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46907, bytes: 29579, op: HDFS_READ, cliID: DFSClient_314529799, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 410330
2013-10-31 18:30:56,571 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0007: nMaps=9 nReduces=1 max=-1
2013-10-31 18:30:56,571 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0007 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:30:56,571 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0007
2013-10-31 18:30:56,572 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0007 RESULT=SUCCESS
2013-10-31 18:30:56,572 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0007
2013-10-31 18:30:56,574 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merge] submitted hadoop job: job_20131031182606197_0007
2013-10-31 18:30:56,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,610 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml. blk_-3790333918479950543_1065
2013-10-31 18:30:56,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:46625 dest: /127.0.0.1:37740
2013-10-31 18:30:56,614 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:46909 dest: /127.0.0.1:54365
2013-10-31 18:30:56,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3790333918479950543_1065 src: /127.0.0.1:42736 dest: /127.0.0.1:59471
2013-10-31 18:30:56,621 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42736, dest: /127.0.0.1:59471, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3790333918479950543_1065, duration: 2137349
2013-10-31 18:30:56,622 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,623 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46909, dest: /127.0.0.1:54365, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3790333918479950543_1065, duration: 3834333
2013-10-31 18:30:56,624 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,625 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46625, dest: /127.0.0.1:37740, bytes: 29412, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3790333918479950543_1065, duration: 5287648
2013-10-31 18:30:56,625 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3790333918479950543_1065 terminating
2013-10-31 18:30:56,628 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,629 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml from client DFSClient_314529799
2013-10-31 18:30:56,629 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_conf.xml is closed by DFSClient_314529799
2013-10-31 18:30:56,629 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,630 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3790333918479950543_1065 size 29412
2013-10-31 18:30:56,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:30:56,642 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken. blk_-8063380550776907754_1066
2013-10-31 18:30:56,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:42737 dest: /127.0.0.1:59471
2013-10-31 18:30:56,645 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:46629 dest: /127.0.0.1:37740
2013-10-31 18:30:56,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8063380550776907754_1066 src: /127.0.0.1:49542 dest: /127.0.0.1:34578
2013-10-31 18:30:56,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 952959
2013-10-31 18:30:56,651 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,652 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46629, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 2725429
2013-10-31 18:30:56,652 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,654 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42737, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8063380550776907754_1066, duration: 4477718
2013-10-31 18:30:56,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,655 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8063380550776907754_1066 terminating
2013-10-31 18:30:56,655 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,657 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8063380550776907754_1066 size 116
2013-10-31 18:30:56,658 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken from client DFSClient_-1596270109
2013-10-31 18:30:56,658 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:30:56,663 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken
2013-10-31 18:30:56,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.splitmetainfo dst=null perm=null
2013-10-31 18:30:56,667 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42740, bytes: 327, op: HDFS_READ, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1355772319426900150_1062, duration: 345816
2013-10-31 18:30:56,669 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0007 = 53. Number of splits = 9
2013-10-31 18:30:56,669 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,670 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,671 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,672 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,673 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,674 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000006 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000007 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,675 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0007_m_000008 has split on node:/default-rack/127.0.0.1
2013-10-31 18:30:56,676 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0007 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:30:56,677 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0007 initialized successfully with 9 map tasks and 1 reduce tasks.
2013-10-31 18:30:58,375 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_7334543370624894983_1060 to datanode(s) 127.0.0.1:34578
2013-10-31 18:30:58,376 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1426554221262928588_1056
2013-10-31 18:30:58,376 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_1426554221262928588_1056
2013-10-31 18:30:58,809 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0007_m_000010_0' to tip task_20131031182606197_0007_m_000010, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:30:58,815 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000010_0 task's state:UNASSIGNED
2013-10-31 18:30:58,815 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000010_0 which needs 1 slots
2013-10-31 18:30:58,815 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000010_0 which needs 1 slots
2013-10-31 18:30:58,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken dst=null perm=null
2013-10-31 18:30:58,824 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49544, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 318453
2013-10-31 18:30:58,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=null
2013-10-31 18:30:58,835 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46917, bytes: 29579, op: HDFS_READ, cliID: DFSClient_1394048599, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6179045511188231419_1063, duration: 388648
2013-10-31 18:30:58,862 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:30:58,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=null
2013-10-31 18:30:58,881 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46635, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1394048599, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 1385173
2013-10-31 18:30:58,979 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0006_m_95840884
2013-10-31 18:30:58,986 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19730 with signal TERM. Exit code 0
2013-10-31 18:30:58,986 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:30:58,986 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1975138276 spawned.
2013-10-31 18:30:58,987 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000010_0/taskjvm.sh
2013-10-31 18:30:58,998 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data4/current/blk_1426554221262928588 for deletion
2013-10-31 18:30:58,999 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data4/current/blk_1426554221262928588
2013-10-31 18:30:59,076 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:30:59,076 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:30:59,076 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:30:59,076 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_95840884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:30:59,710 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data5/current/blk_1426554221262928588 for deletion
2013-10-31 18:30:59,710 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data5/current/blk_1426554221262928588
2013-10-31 18:31:00,197 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_7334543370624894983_1060 to 127.0.0.1:34578
2013-10-31 18:31:00,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7334543370624894983_1060 src: /127.0.0.1:49549 dest: /127.0.0.1:34578
2013-10-31 18:31:00,198 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_7334543370624894983_1060 to /127.0.0.1:34578
2013-10-31 18:31:00,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_7334543370624894983_1060 src: /127.0.0.1:49549 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:31:00,203 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7334543370624894983_1060 size 238055
2013-10-31 18:31:00,227 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:00,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:00,805 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,806 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0006_m_000004_0 not found in cache
2013-10-31 18:31:00,807 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660807
2013-10-31 18:31:00,843 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,844 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660844
2013-10-31 18:31:00,855 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,856 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660856
2013-10-31 18:31:00,868 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0006
2013-10-31 18:31:00,869 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0006 for user-log deletion with retainTimeStamp:1383330660869
2013-10-31 18:31:00,898 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_r_-1824933735 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:00,908 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19928 with signal TERM. Exit code 0
2013-10-31 18:31:01,076 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,076 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,076 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:01,077 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_r_-1824933735 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,173 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_941089074 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,173 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_-888949500 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,184 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19805 with signal TERM. Exit code 0
2013-10-31 18:31:01,185 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19806 with signal TERM. Exit code 0
2013-10-31 18:31:01,377 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1426554221262928588_1056
2013-10-31 18:31:01,380 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,380 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,380 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:01,380 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_941089074 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,389 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:01,389 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:01,390 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:01,390 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_-888949500 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:01,915 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_-740270901 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:01,928 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19617 with signal TERM. Exit code 0
2013-10-31 18:31:02,111 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:02,112 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:02,112 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:02,112 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_-740270901 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:31:02,164 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0006_m_1952810705 since job job_20131031182606197_0006 is dead
2013-10-31 18:31:02,174 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group19893 with signal TERM. Exit code 0
2013-10-31 18:31:02,392 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:02,392 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:02,392 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:02,392 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0006_m_1952810705 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:03,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1426554221262928588_1056 file build/test/data/dfs/data/data2/current/blk_1426554221262928588 for deletion
2013-10-31 18:31:03,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1426554221262928588_1056 at file build/test/data/dfs/data/data2/current/blk_1426554221262928588
2013-10-31 18:31:03,644 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000010_0 0.0% setup
2013-10-31 18:31:03,647 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000010_0 is done.
2013-10-31 18:31:03,648 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000010_0 was -1
2013-10-31 18:31:03,648 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:04,819 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000010_0' has completed task_20131031182606197_0007_m_000010 successfully.
2013-10-31 18:31:04,823 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000000_0' to tip task_20131031182606197_0007_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:04,824 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000000
2013-10-31 18:31:04,824 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000001_0' to tip task_20131031182606197_0007_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:04,825 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000001
2013-10-31 18:31:04,827 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:04,828 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:31:04,828 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000000_0 which needs 1 slots
2013-10-31 18:31:04,828 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000000_0 which needs 1 slots
2013-10-31 18:31:04,829 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000001_0 which needs 1 slots
2013-10-31 18:31:04,829 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000001_0 which needs 1 slots
2013-10-31 18:31:04,854 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000002_0' to tip task_20131031182606197_0007_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:04,855 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000002
2013-10-31 18:31:04,856 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000003_0' to tip task_20131031182606197_0007_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:04,856 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000003
2013-10-31 18:31:04,857 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:31:04,857 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:31:04,858 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000002_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000002_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000003_0 which needs 1 slots
2013-10-31 18:31:04,858 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000003_0 which needs 1 slots
2013-10-31 18:31:04,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken dst=null perm=null
2013-10-31 18:31:04,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46639, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 147115
2013-10-31 18:31:04,863 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000004_0' to tip task_20131031182606197_0007_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:04,863 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000004
2013-10-31 18:31:04,863 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000005_0' to tip task_20131031182606197_0007_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:04,863 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000005
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000004_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000004_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000005_0 which needs 1 slots
2013-10-31 18:31:04,866 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000005_0 which needs 1 slots
2013-10-31 18:31:04,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=null
2013-10-31 18:31:04,867 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:04,868 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1626281300 spawned.
2013-10-31 18:31:04,868 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000001_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:04,869 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000000_0/taskjvm.sh
2013-10-31 18:31:04,870 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49553, bytes: 29579, op: HDFS_READ, cliID: DFSClient_1615040230, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 187361
2013-10-31 18:31:04,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken dst=null perm=null
2013-10-31 18:31:04,871 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49554, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8063380550776907754_1066, duration: 160675
2013-10-31 18:31:04,874 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000006_0' to tip task_20131031182606197_0007_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:04,874 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000006
2013-10-31 18:31:04,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=null
2013-10-31 18:31:04,875 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000007_0' to tip task_20131031182606197_0007_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:04,875 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000007
2013-10-31 18:31:04,876 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:31:04,876 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:31:04,876 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000006_0 which needs 1 slots
2013-10-31 18:31:04,876 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000006_0 which needs 1 slots
2013-10-31 18:31:04,876 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000007_0 which needs 1 slots
2013-10-31 18:31:04,877 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0007_m_000007_0 which needs 1 slots
2013-10-31 18:31:04,877 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49556, bytes: 29579, op: HDFS_READ, cliID: DFSClient_922432685, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 209484
2013-10-31 18:31:04,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007/jobToken dst=null perm=null
2013-10-31 18:31:04,880 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46645, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8063380550776907754_1066, duration: 113887
2013-10-31 18:31:04,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.xml dst=null perm=null
2013-10-31 18:31:04,884 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,885 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49559, bytes: 29579, op: HDFS_READ, cliID: DFSClient_-829471730, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6179045511188231419_1063, duration: 164898
2013-10-31 18:31:04,890 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=null
2013-10-31 18:31:04,898 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:04,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46648, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1615040230, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7334543370624894983_1060, duration: 630186
2013-10-31 18:31:04,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=null
2013-10-31 18:31:04,905 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42758, bytes: 239915, op: HDFS_READ, cliID: DFSClient_922432685, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7334543370624894983_1060, duration: 669502
2013-10-31 18:31:04,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.jar dst=null perm=null
2013-10-31 18:31:04,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49562, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-829471730, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7334543370624894983_1060, duration: 671272
2013-10-31 18:31:04,967 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1489999599
2013-10-31 18:31:04,968 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1489999599 spawned.
2013-10-31 18:31:04,968 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-977462392
2013-10-31 18:31:04,969 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-977462392 spawned.
2013-10-31 18:31:04,970 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000003_0/taskjvm.sh
2013-10-31 18:31:04,971 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000002_0/taskjvm.sh
2013-10-31 18:31:05,050 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1239478468
2013-10-31 18:31:05,052 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1239478468 spawned.
2013-10-31 18:31:05,053 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_-1003825976
2013-10-31 18:31:05,053 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1064165913
2013-10-31 18:31:05,054 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_-1003825976 spawned.
2013-10-31 18:31:05,057 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1064165913 spawned.
2013-10-31 18:31:05,059 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_m_1599992582
2013-10-31 18:31:05,060 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_m_1599992582 spawned.
2013-10-31 18:31:05,060 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000005_0/taskjvm.sh
2013-10-31 18:31:05,064 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000007_0/taskjvm.sh
2013-10-31 18:31:05,064 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000004_0/taskjvm.sh
2013-10-31 18:31:05,065 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_m_000006_0/taskjvm.sh
2013-10-31 18:31:05,210 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000001_0
2013-10-31 18:31:05,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:05,329 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49564, bytes: 3161, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 178094
2013-10-31 18:31:05,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:31:05,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49565, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 110737
2013-10-31 18:31:07,247 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1489999599 given task: attempt_20131031182606197_0007_m_000003_0
2013-10-31 18:31:07,249 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1064165913 given task: attempt_20131031182606197_0007_m_000004_0
2013-10-31 18:31:07,251 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1599992582 given task: attempt_20131031182606197_0007_m_000006_0
2013-10-31 18:31:07,260 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-977462392 given task: attempt_20131031182606197_0007_m_000002_0
2013-10-31 18:31:07,271 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1239478468 given task: attempt_20131031182606197_0007_m_000005_0
2013-10-31 18:31:07,274 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1626281300 given task: attempt_20131031182606197_0007_m_000000_0
2013-10-31 18:31:07,313 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_-1003825976 given task: attempt_20131031182606197_0007_m_000007_0
2013-10-31 18:31:07,810 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:31:07,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46950, bytes: 2129, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 195927
2013-10-31 18:31:07,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,832 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46952, bytes: 3161, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 171011
2013-10-31 18:31:07,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,844 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49582, bytes: 2129, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000004_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 169050
2013-10-31 18:31:07,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:31:07,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46955, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 132900
2013-10-31 18:31:07,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46954, bytes: 1613, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000005_0, offset: 1536, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 149000
2013-10-31 18:31:07,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49585, bytes: 1097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000006_0, offset: 2048, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2855333912159915853_1061, duration: 148092
2013-10-31 18:31:07,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:31:07,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,882 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46957, bytes: 2645, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2855333912159915853_1061, duration: 164735
2013-10-31 18:31:07,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 18:31:07,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:31:07,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:07,909 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46675, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000006_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 155727
2013-10-31 18:31:07,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42785, bytes: 1097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000007_0, offset: 2048, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2855333912159915853_1061, duration: 159382
2013-10-31 18:31:07,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 18:31:07,923 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46677, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000005_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-249196459070022847_1059, duration: 180115
2013-10-31 18:31:07,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:31:07,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt dst=null perm=null
2013-10-31 18:31:07,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42787, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000007_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-249196459070022847_1059, duration: 1596955
2013-10-31 18:31:08,143 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49591, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 147202
2013-10-31 18:31:08,150 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:46963, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-249196459070022847_1059, duration: 121528
2013-10-31 18:31:08,192 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42790, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 154778
2013-10-31 18:31:08,290 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:31:08,292 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000001_0 is done.
2013-10-31 18:31:08,292 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000001_0 was 54
2013-10-31 18:31:08,292 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:09,828 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:09,829 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0007_m_000010_0
2013-10-31 18:31:09,829 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0007_m_000010_0 not found in cache
2013-10-31 18:31:10,735 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:31:10,739 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000003_0 is done.
2013-10-31 18:31:10,739 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000003_0 was 54
2013-10-31 18:31:10,740 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,756 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:31:10,758 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000000_0 is done.
2013-10-31 18:31:10,758 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000000_0 was 78
2013-10-31 18:31:10,758 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,769 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:0+7
2013-10-31 18:31:10,771 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000004_0 is done.
2013-10-31 18:31:10,772 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000004_0 was 54
2013-10-31 18:31:10,772 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,777 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000005_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:7+7
2013-10-31 18:31:10,778 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000005_0 is done.
2013-10-31 18:31:10,779 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000005_0 was 54
2013-10-31 18:31:10,779 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,791 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000006_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:31:10,792 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000006_0 is done.
2013-10-31 18:31:10,793 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000006_0 was 6
2013-10-31 18:31:10,793 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:31:10,803 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:31:10,805 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000002_0 is done.
2013-10-31 18:31:10,805 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000002_0 was 78
2013-10-31 18:31:10,805 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,830 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000000_0' has completed task_20131031182606197_0007_m_000000 successfully.
2013-10-31 18:31:10,831 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000001_0' has completed task_20131031182606197_0007_m_000001 successfully.
2013-10-31 18:31:10,833 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0007_m_000008_0' to tip task_20131031182606197_0007_m_000008, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:10,833 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0007_m_000008
2013-10-31 18:31:10,833 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0007_r_000000_0' to tip task_20131031182606197_0007_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000008_0 task's state:UNASSIGNED
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000008_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_r_000000_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000008_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_r_000000_0 which needs 1 slots
2013-10-31 18:31:10,835 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000007_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower-offset.txt:14+1
2013-10-31 18:31:10,837 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000007_0 is done.
2013-10-31 18:31:10,838 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000007_0 was 6
2013-10-31 18:31:10,839 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:10,857 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0007_r_629524259
2013-10-31 18:31:10,857 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0007_r_629524259 spawned.
2013-10-31 18:31:10,858 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000008_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:10,859 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0007/attempt_20131031182606197_0007_r_000000_0/taskjvm.sh
2013-10-31 18:31:10,861 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000002_0' has completed task_20131031182606197_0007_m_000002 successfully.
2013-10-31 18:31:11,217 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000003_0' has completed task_20131031182606197_0007_m_000003 successfully.
2013-10-31 18:31:11,220 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000006_0' has completed task_20131031182606197_0007_m_000006 successfully.
2013-10-31 18:31:11,222 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000007_0' has completed task_20131031182606197_0007_m_000007 successfully.
2013-10-31 18:31:11,225 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000004_0' has completed task_20131031182606197_0007_m_000004 successfully.
2013-10-31 18:31:11,227 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000005_0' has completed task_20131031182606197_0007_m_000005 successfully.
2013-10-31 18:31:11,810 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000008_0
2013-10-31 18:31:11,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007/job.split dst=null perm=null
2013-10-31 18:31:11,894 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46684, bytes: 581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000008_0, offset: 2560, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2855333912159915853_1061, duration: 166490
2013-10-31 18:31:11,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:31:11,898 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46685, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0007_m_000008_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 100520
2013-10-31 18:31:12,016 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_r_629524259 given task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:14,869 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000008_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:31:14,873 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000008_0 is done.
2013-10-31 18:31:14,873 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000008_0 was 6
2013-10-31 18:31:14,873 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:16,842 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000008_0' has completed task_20131031182606197_0007_m_000008 successfully.
2013-10-31 18:31:17,689 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48636, bytes: 78, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000000_0, duration: 9942435
2013-10-31 18:31:17,715 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48636, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000001_0, duration: 12003031
2013-10-31 18:31:17,732 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38982, bytes: 78, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000002_0, duration: 12152067
2013-10-31 18:31:17,747 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:38982, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000003_0, duration: 11611554
2013-10-31 18:31:17,765 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41004, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000006_0, duration: 12667798
2013-10-31 18:31:17,780 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41004, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000007_0, duration: 11613046
2013-10-31 18:31:17,797 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43681, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000004_0, duration: 12327733
2013-10-31 18:31:17,813 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43681, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000005_0, duration: 11706648
2013-10-31 18:31:18,498 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) >
2013-10-31 18:31:20,038 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 8 OK for attempt_20131031182606197_0007_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:31:21,554 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) >
2013-10-31 18:31:22,838 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48640, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0007_m_000008_0, duration: 14414097
2013-10-31 18:31:23,561 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) >
2013-10-31 18:31:23,616 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) >
2013-10-31 18:31:23,820 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 345 Total time for transactions(ms): 8Number of transactions batched in Syncs: 13 Number of syncs: 235 SyncTimes(ms): 29582 9755
2013-10-31 18:31:23,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:23,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:23,849 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000. blk_5160783804709220597_1067
2013-10-31 18:31:23,887 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:42803 dest: /127.0.0.1:59471
2013-10-31 18:31:23,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:46695 dest: /127.0.0.1:37740
2013-10-31 18:31:23,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5160783804709220597_1067 src: /127.0.0.1:49608 dest: /127.0.0.1:34578
2013-10-31 18:31:23,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49608, dest: /127.0.0.1:34578, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5160783804709220597_1067, duration: 1623032
2013-10-31 18:31:23,892 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46695, dest: /127.0.0.1:37740, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5160783804709220597_1067, duration: 2723005
2013-10-31 18:31:23,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,893 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42803, dest: /127.0.0.1:59471, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0007_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5160783804709220597_1067, duration: 3505618
2013-10-31 18:31:23,893 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5160783804709220597_1067 terminating
2013-10-31 18:31:23,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,896 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:23,896 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:23,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5160783804709220597_1067 size 24
2013-10-31 18:31:23,931 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0007_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:23,931 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 0.2962963% reduce > copy (8 of 9 at 0.00 MB/s) >
2013-10-31 18:31:26,004 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 30
2013-10-31 18:31:26,046 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0007_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:31:26,047 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:26,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0 dst=null perm=null
2013-10-31 18:31:26,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:26,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:27,601 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:30,651 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:33,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary/_attempt_20131031182606197_0007_r_000000_0 dst=null perm=null
2013-10-31 18:31:33,657 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_r_000000_0 1.0% reduce > reduce
2013-10-31 18:31:33,660 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_r_000000_0 is done.
2013-10-31 18:31:33,660 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_r_000000_0 was -1
2013-10-31 18:31:33,661 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:35,058 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_r_000000_0' has completed task_20131031182606197_0007_r_000000 successfully.
2013-10-31 18:31:35,067 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0007_m_000009_0' to tip task_20131031182606197_0007_m_000009, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:35,069 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0007_m_000009_0 task's state:UNASSIGNED
2013-10-31 18:31:35,070 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0007_m_000009_0 which needs 1 slots
2013-10-31 18:31:35,070 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0007_m_000009_0 which needs 1 slots
2013-10-31 18:31:35,104 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0007/attempt_20131031182606197_0007_m_000009_0. Attempting to reuse: jvm_20131031182606197_0007_m_1975138276
2013-10-31 18:31:36,298 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0007_m_1975138276 given task: attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,412 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000009_0 0.0%
2013-10-31 18:31:36,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary dst=null perm=null
2013-10-31 18:31:36,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:36,428 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS from client DFSClient_attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,428 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0007_m_000009_0
2013-10-31 18:31:36,432 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,432 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,432 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,432 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7334543370624894983 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2855333912159915853 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1355772319426900150 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:36,433 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6179045511188231419 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:36,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0007 dst=null perm=null
2013-10-31 18:31:37,383 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_7334543370624894983_1060 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:37,383 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:38,724 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data6/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:38,724 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data5/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:38,724 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data6/current/blk_-1355772319426900150
2013-10-31 18:31:38,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data5/current/blk_2855333912159915853
2013-10-31 18:31:38,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data5/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:38,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data6/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:38,725 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data5/current/blk_6179045511188231419
2013-10-31 18:31:38,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data6/current/blk_7334543370624894983
2013-10-31 18:31:39,138 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data2/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:39,138 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data1/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:39,138 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data2/current/blk_2855333912159915853
2013-10-31 18:31:39,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data1/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:39,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data1/current/blk_6179045511188231419
2013-10-31 18:31:39,139 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data1/current/blk_7334543370624894983
2013-10-31 18:31:39,389 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0007_m_000009_0 0.0% cleanup
2013-10-31 18:31:39,391 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0007_m_000009_0 is done.
2013-10-31 18:31:39,391 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0007_m_000009_0 was -1
2013-10-31 18:31:39,391 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:40,070 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:40,070 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0007_r_000000_0
2013-10-31 18:31:40,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061
2013-10-31 18:31:40,384 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_7334543370624894983_1060 blk_-1355772319426900150_1062 blk_2855333912159915853_1061 blk_6179045511188231419_1063
2013-10-31 18:31:41,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data3/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:41,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data4/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:41,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data3/current/blk_-1355772319426900150
2013-10-31 18:31:41,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6179045511188231419_1063 file build/test/data/dfs/data/data4/current/blk_6179045511188231419 for deletion
2013-10-31 18:31:41,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data4/current/blk_2855333912159915853
2013-10-31 18:31:41,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data3/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:41,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6179045511188231419_1063 at file build/test/data/dfs/data/data4/current/blk_6179045511188231419
2013-10-31 18:31:41,015 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data3/current/blk_7334543370624894983
2013-10-31 18:31:41,076 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0007_m_000009_0' has completed task_20131031182606197_0007_m_000009 successfully.
2013-10-31 18:31:41,077 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0007 has completed successfully.
2013-10-31 18:31:41,077 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0007,submitTime=1383244256542,launchTime=1383244256676,firstMapTaskLaunchTime=1383244264823,firstReduceTaskLaunchTime=1383244270833,firstJobSetupTaskLaunchTime=1383244258808,firstJobCleanupTaskLaunchTime=1383244295067,finishTime=1383244301077,numMaps=9,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=57,reduceSlotsSeconds=22,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E0ECF75E124F455BBA40E7F3F5C3C75D/5FCF53C57E7E49A29505C93E4A8E34E7] merge/(1/1) ...platform/simplemergethree
2013-10-31 18:31:41,083 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2. blk_3514339520619960332_1068
2013-10-31 18:31:41,085 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:46703 dest: /127.0.0.1:37740
2013-10-31 18:31:41,087 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:49616 dest: /127.0.0.1:34578
2013-10-31 18:31:41,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3514339520619960332_1068 src: /127.0.0.1:42814 dest: /127.0.0.1:59471
2013-10-31 18:31:41,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42814, dest: /127.0.0.1:59471, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3514339520619960332_1068, duration: 7829400
2013-10-31 18:31:41,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,102 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49616, dest: /127.0.0.1:34578, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3514339520619960332_1068, duration: 7000101
2013-10-31 18:31:41,102 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,103 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46703, dest: /127.0.0.1:37740, bytes: 45910, op: HDFS_WRITE, cliID: DFSClient_314529799, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3514339520619960332_1068, duration: 10110119
2013-10-31 18:31:41,104 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3514339520619960332_1068 terminating
2013-10-31 18:31:41,110 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,111 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 from client DFSClient_314529799
2013-10-31 18:31:41,111 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_logs/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 is closed by DFSClient_314529799
2013-10-31 18:31:41,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,112 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3514339520619960332_1068 size 45910
2013-10-31 18:31:41,118 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0007_1383244256542_hadoop_%5BE0ECF75E124F455BBA40E7F3F5C3C75D%2F5FCF53C57E7E49A2 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:31:41,118 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000000_0'
2013-10-31 18:31:41,118 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000001_0'
2013-10-31 18:31:41,118 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000008_0'
2013-10-31 18:31:41,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000009_0'
2013-10-31 18:31:41,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000010_0'
2013-10-31 18:31:41,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_r_000000_0'
2013-10-31 18:31:41,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:31:41,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:31:41,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8063380550776907754 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:31:41,123 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/_temporary
2013-10-31 18:31:41,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0007 dst=null perm=null
2013-10-31 18:31:41,126 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0007_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:31:41,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree dst=null perm=null
2013-10-31 18:31:41,172 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:31:41,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000 dst=null perm=null
2013-10-31 18:31:41,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000 dst=null perm=null
2013-10-31 18:31:41,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49619, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5160783804709220597_1067, duration: 132167
2013-10-31 18:31:41,176 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/simplemergethree
2013-10-31 18:31:41,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree dst=null perm=null
2013-10-31 18:31:41,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/simplemergethree/part-00000 dst=null perm=null
2013-10-31 18:31:41,182 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46708, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5160783804709220597_1067, duration: 140059
2013-10-31 18:31:41,200 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:31:41,200 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:31:41,227 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:31:41,227 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:31:41,227 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1"]
2013-10-31 18:31:41,227 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2"]
2013-10-31 18:31:41,227 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] parallel execution is enabled: true
2013-10-31 18:31:41,228 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting jobs: 3
2013-10-31 18:31:41,228 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] allocating threads: 3
2013-10-31 18:31:41,229 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/3)
2013-10-31 18:31:41,236 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:31:41,236 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:31:41,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:41,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:31:41,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000002_0'
2013-10-31 18:31:41,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000003_0'
2013-10-31 18:31:41,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,256 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar. blk_-6615452559817063764_1069
2013-10-31 18:31:41,258 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:49621 dest: /127.0.0.1:34578
2013-10-31 18:31:41,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:46710 dest: /127.0.0.1:37740
2013-10-31 18:31:41,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:42820 dest: /127.0.0.1:59471
2013-10-31 18:31:41,267 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42820, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 5440178
2013-10-31 18:31:41,267 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,268 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46710, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6615452559817063764_1069, duration: 5849556
2013-10-31 18:31:41,268 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,269 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49621, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6615452559817063764_1069, duration: 6621527
2013-10-31 18:31:41,270 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,270 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6615452559817063764_1069 terminating
2013-10-31 18:31:41,271 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar from client DFSClient_-1596270109
2013-10-31 18:31:41,272 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:31:41,274 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:41,277 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar. New replication is 10
2013-10-31 18:31:41,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=null
2013-10-31 18:31:41,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,285 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:31:41,288 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000006_0'
2013-10-31 18:31:41,288 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000007_0'
2013-10-31 18:31:41,289 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000004_0'
2013-10-31 18:31:41,289 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0007_m_000005_0'
2013-10-31 18:31:41,290 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:31:41,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:31:41,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,302 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split. New replication is 10
2013-10-31 18:31:41,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=null
2013-10-31 18:31:41,308 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split. blk_-5211779972710902284_1070
2013-10-31 18:31:41,309 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:46995 dest: /127.0.0.1:54365
2013-10-31 18:31:41,310 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:49625 dest: /127.0.0.1:34578
2013-10-31 18:31:41,311 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:42823 dest: /127.0.0.1:59471
2013-10-31 18:31:41,312 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5211779972710902284_1070 src: /127.0.0.1:46715 dest: /127.0.0.1:37740
2013-10-31 18:31:41,315 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46715, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 547929
2013-10-31 18:31:41,315 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,316 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42823, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5211779972710902284_1070, duration: 1740433
2013-10-31 18:31:41,315 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,316 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,317 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49625, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5211779972710902284_1070, duration: 2627464
2013-10-31 18:31:41,317 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,318 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46995, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5211779972710902284_1070, duration: 3486682
2013-10-31 18:31:41,318 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5211779972710902284_1070 terminating
2013-10-31 18:31:41,321 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,321 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split from client DFSClient_-1596270109
2013-10-31 18:31:41,322 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split is closed by DFSClient_-1596270109
2013-10-31 18:31:41,322 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,322 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5211779972710902284_1070 size 1403
2013-10-31 18:31:41,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:41,337 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo. blk_-8801034186855298322_1071
2013-10-31 18:31:41,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:46716 dest: /127.0.0.1:37740
2013-10-31 18:31:41,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:49629 dest: /127.0.0.1:34578
2013-10-31 18:31:41,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8801034186855298322_1071 src: /127.0.0.1:47001 dest: /127.0.0.1:54365
2013-10-31 18:31:41,344 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47001, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8801034186855298322_1071, duration: 431980
2013-10-31 18:31:41,344 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,345 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49629, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8801034186855298322_1071, duration: 1636610
2013-10-31 18:31:41,345 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,345 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46716, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8801034186855298322_1071, duration: 2399954
2013-10-31 18:31:41,346 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8801034186855298322_1071 terminating
2013-10-31 18:31:41,348 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:41,348 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:31:41,348 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:31:41,349 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:41,349 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8801034186855298322_1071 size 156
2013-10-31 18:31:42,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1355772319426900150_1062 file build/test/data/dfs/data/data8/current/blk_-1355772319426900150 for deletion
2013-10-31 18:31:42,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2855333912159915853_1061 file build/test/data/dfs/data/data7/current/blk_2855333912159915853 for deletion
2013-10-31 18:31:42,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1355772319426900150_1062 at file build/test/data/dfs/data/data8/current/blk_-1355772319426900150
2013-10-31 18:31:42,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7334543370624894983_1060 file build/test/data/dfs/data/data8/current/blk_7334543370624894983 for deletion
2013-10-31 18:31:42,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2855333912159915853_1061 at file build/test/data/dfs/data/data7/current/blk_2855333912159915853
2013-10-31 18:31:42,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7334543370624894983_1060 at file build/test/data/dfs/data/data8/current/blk_7334543370624894983
2013-10-31 18:31:43,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,063 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml. blk_2565033199268478674_1072
2013-10-31 18:31:43,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:42828 dest: /127.0.0.1:59471
2013-10-31 18:31:43,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:49632 dest: /127.0.0.1:34578
2013-10-31 18:31:43,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2565033199268478674_1072 src: /127.0.0.1:46721 dest: /127.0.0.1:37740
2013-10-31 18:31:43,074 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46721, dest: /127.0.0.1:37740, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2565033199268478674_1072, duration: 3235334
2013-10-31 18:31:43,075 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49632, dest: /127.0.0.1:34578, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 4741626
2013-10-31 18:31:43,077 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,078 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42828, dest: /127.0.0.1:59471, bytes: 27746, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2565033199268478674_1072, duration: 6392916
2013-10-31 18:31:43,078 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,078 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2565033199268478674_1072 terminating
2013-10-31 18:31:43,082 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,082 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml from client DFSClient_-1596270109
2013-10-31 18:31:43,083 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:31:43,083 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2565033199268478674_1072 size 27746
2013-10-31 18:31:43,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=null
2013-10-31 18:31:43,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49635, bytes: 27966, op: HDFS_READ, cliID: DFSClient_786869453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 415553
2013-10-31 18:31:43,137 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0008: nMaps=4 nReduces=0 max=-1
2013-10-31 18:31:43,137 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0008 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:31:43,138 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0008
2013-10-31 18:31:43,138 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0008 RESULT=SUCCESS
2013-10-31 18:31:43,138 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0008
2013-10-31 18:31:43,139 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0008
2013-10-31 18:31:43,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,173 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml. blk_-2396101614590861125_1074
2013-10-31 18:31:43,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:46724 dest: /127.0.0.1:37740
2013-10-31 18:31:43,177 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:49637 dest: /127.0.0.1:34578
2013-10-31 18:31:43,179 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2396101614590861125_1074 src: /127.0.0.1:47009 dest: /127.0.0.1:54365
2013-10-31 18:31:43,185 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47009, dest: /127.0.0.1:54365, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2396101614590861125_1074, duration: 2732260
2013-10-31 18:31:43,185 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,186 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49637, dest: /127.0.0.1:34578, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2396101614590861125_1074, duration: 3621707
2013-10-31 18:31:43,186 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,187 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46724, dest: /127.0.0.1:37740, bytes: 27811, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2396101614590861125_1074, duration: 4475831
2013-10-31 18:31:43,187 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2396101614590861125_1074 terminating
2013-10-31 18:31:43,190 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,191 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml from client DFSClient_786869453
2013-10-31 18:31:43,191 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_conf.xml is closed by DFSClient_786869453
2013-10-31 18:31:43,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2396101614590861125_1074 size 27811
2013-10-31 18:31:43,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:43,206 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken. blk_3249008124411573785_1075
2013-10-31 18:31:43,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:46727 dest: /127.0.0.1:37740
2013-10-31 18:31:43,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:42837 dest: /127.0.0.1:59471
2013-10-31 18:31:43,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3249008124411573785_1075 src: /127.0.0.1:49641 dest: /127.0.0.1:34578
2013-10-31 18:31:43,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49641, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 969181
2013-10-31 18:31:43,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,219 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42837, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3249008124411573785_1075, duration: 2954813
2013-10-31 18:31:43,219 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,220 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46727, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3249008124411573785_1075, duration: 5236791
2013-10-31 18:31:43,221 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,222 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3249008124411573785_1075 terminating
2013-10-31 18:31:43,225 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken from client DFSClient_-1596270109
2013-10-31 18:31:43,225 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:31:43,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3249008124411573785_1075 size 116
2013-10-31 18:31:43,229 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken
2013-10-31 18:31:43,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.splitmetainfo dst=null perm=null
2013-10-31 18:31:43,234 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46730, bytes: 160, op: HDFS_READ, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8801034186855298322_1071, duration: 286256
2013-10-31 18:31:43,235 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0008 = 1449. Number of splits = 4
2013-10-31 18:31:43,235 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,236 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,237 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0008_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:31:43,238 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0008 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:31:43,239 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0008 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:31:43,385 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-6615452559817063764_1069 to datanode(s) 127.0.0.1:54365
2013-10-31 18:31:43,385 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-8063380550776907754_1066
2013-10-31 18:31:43,386 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-8063380550776907754_1066
2013-10-31 18:31:44,124 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0008_m_000005_0' to tip task_20131031182606197_0008_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:44,131 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:31:44,132 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000005_0 which needs 1 slots
2013-10-31 18:31:44,132 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000005_0 which needs 1 slots
2013-10-31 18:31:44,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken dst=null perm=null
2013-10-31 18:31:44,142 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42841, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3249008124411573785_1075, duration: 314454
2013-10-31 18:31:44,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=null
2013-10-31 18:31:44,153 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46734, bytes: 27966, op: HDFS_READ, cliID: DFSClient_3119137, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2565033199268478674_1072, duration: 394624
2013-10-31 18:31:44,185 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:44,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=null
2013-10-31 18:31:44,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42844, bytes: 239915, op: HDFS_READ, cliID: DFSClient_3119137, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 1409345
2013-10-31 18:31:44,321 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:44,328 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20431 with signal TERM. Exit code 0
2013-10-31 18:31:44,328 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_966824357
2013-10-31 18:31:44,329 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_966824357 spawned.
2013-10-31 18:31:44,331 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000005_0/taskjvm.sh
2013-10-31 18:31:44,357 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0007_m_-1626281300
2013-10-31 18:31:44,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data5/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:44,726 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data5/current/blk_-8063380550776907754
2013-10-31 18:31:45,140 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-6615452559817063764_1069 to 127.0.0.1:54365
2013-10-31 18:31:45,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6615452559817063764_1069 src: /127.0.0.1:47019 dest: /127.0.0.1:54365
2013-10-31 18:31:45,143 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-6615452559817063764_1069 to /127.0.0.1:54365
2013-10-31 18:31:45,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6615452559817063764_1069 src: /127.0.0.1:47019 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:31:45,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6615452559817063764_1069 size 238055
2013-10-31 18:31:45,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data8/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:45,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data8/current/blk_-8063380550776907754
2013-10-31 18:31:45,686 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:45,686 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:45,686 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:45,686 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1626281300 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:46,119 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,120 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0007_m_000009_0 not found in cache
2013-10-31 18:31:46,121 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706121
2013-10-31 18:31:46,213 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_r_629524259 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:46,223 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20858 with signal TERM. Exit code 0
2013-10-31 18:31:46,250 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706251
2013-10-31 18:31:46,288 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,289 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706289
2013-10-31 18:31:46,290 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0007
2013-10-31 18:31:46,290 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0007 for user-log deletion with retainTimeStamp:1383330706290
2013-10-31 18:31:46,298 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_966824357 given task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:46,374 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:46,374 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:46,374 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:46,374 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_r_629524259 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:46,386 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-8063380550776907754_1066
2013-10-31 18:31:46,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:47,326 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-1489999599 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,336 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20432 with signal TERM. Exit code 0
2013-10-31 18:31:47,347 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1064165913 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,359 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20441 with signal TERM. Exit code 0
2013-10-31 18:31:47,360 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1239478468 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,368 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1599992582 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,380 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-977462392 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,382 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20439 with signal TERM. Exit code 0
2013-10-31 18:31:47,387 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20440 with signal TERM. Exit code 0
2013-10-31 18:31:47,403 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20430 with signal TERM. Exit code 0
2013-10-31 18:31:47,428 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_1975138276 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,434 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20210 with signal TERM. Exit code 0
2013-10-31 18:31:47,579 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,580 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,580 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,580 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1064165913 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,606 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,606 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,606 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,606 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-977462392 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,609 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,609 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,609 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,609 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1489999599 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,610 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,610 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,610 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,610 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1975138276 exited with exit code 143. Number of tasks it ran: 4
2013-10-31 18:31:47,613 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,613 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,613 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,613 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1599992582 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,615 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:47,615 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:47,616 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:47,616 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_1239478468 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:47,744 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0007_m_-1003825976 since job job_20131031182606197_0007 is dead
2013-10-31 18:31:47,753 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group20442 with signal TERM. Exit code 0
2013-10-31 18:31:48,002 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:31:48,002 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:31:48,002 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:31:48,003 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0007_m_-1003825976 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:31:48,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8063380550776907754_1066 file build/test/data/dfs/data/data2/current/blk_-8063380550776907754 for deletion
2013-10-31 18:31:48,141 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8063380550776907754_1066 at file build/test/data/dfs/data/data2/current/blk_-8063380550776907754
2013-10-31 18:31:49,736 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000005_0 0.0% setup
2013-10-31 18:31:49,739 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000005_0 is done.
2013-10-31 18:31:49,739 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000005_0 was -1
2013-10-31 18:31:49,739 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:31:50,138 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000005_0' has completed task_20131031182606197_0008_m_000005 successfully.
2013-10-31 18:31:50,142 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000000_0' to tip task_20131031182606197_0008_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:31:50,143 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000000
2013-10-31 18:31:50,144 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:31:50,145 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000000_0 which needs 1 slots
2013-10-31 18:31:50,145 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000000_0 which needs 1 slots
2013-10-31 18:31:50,181 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_-753643868
2013-10-31 18:31:50,182 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_-753643868 spawned.
2013-10-31 18:31:50,184 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000000_0/taskjvm.sh
2013-10-31 18:31:50,259 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000001_0' to tip task_20131031182606197_0008_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:31:50,259 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000001
2013-10-31 18:31:50,261 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:31:50,261 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000001_0 which needs 1 slots
2013-10-31 18:31:50,261 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000001_0 which needs 1 slots
2013-10-31 18:31:50,295 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000002_0' to tip task_20131031182606197_0008_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:31:50,296 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000002
2013-10-31 18:31:50,297 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:31:50,297 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000002_0 which needs 1 slots
2013-10-31 18:31:50,297 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000002_0 which needs 1 slots
2013-10-31 18:31:50,298 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0008_m_000003_0' to tip task_20131031182606197_0008_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:31:50,298 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0008_m_000003
2013-10-31 18:31:50,300 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:31:50,300 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000003_0 which needs 1 slots
2013-10-31 18:31:50,300 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000003_0 which needs 1 slots
2013-10-31 18:31:50,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken dst=null perm=null
2013-10-31 18:31:50,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken dst=null perm=null
2013-10-31 18:31:50,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008/jobToken dst=null perm=null
2013-10-31 18:31:50,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49651, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 304550
2013-10-31 18:31:50,605 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46740, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3249008124411573785_1075, duration: 384960
2013-10-31 18:31:50,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=null
2013-10-31 18:31:50,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=null
2013-10-31 18:31:50,617 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49655, bytes: 27966, op: HDFS_READ, cliID: DFSClient_1644234686, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 410485
2013-10-31 18:31:50,617 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49656, bytes: 27966, op: HDFS_READ, cliID: DFSClient_-245661260, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2565033199268478674_1072, duration: 419555
2013-10-31 18:31:50,641 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49657, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3249008124411573785_1075, duration: 276762
2013-10-31 18:31:50,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.xml dst=null perm=null
2013-10-31 18:31:50,646 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42856, bytes: 27966, op: HDFS_READ, cliID: DFSClient_1145407818, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2565033199268478674_1072, duration: 391729
2013-10-31 18:31:50,664 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=null
2013-10-31 18:31:50,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42857, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1145407818, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6615452559817063764_1069, duration: 1292422
2013-10-31 18:31:50,773 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:31:50,774 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_-1990778351 spawned.
2013-10-31 18:31:50,776 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000002_0/taskjvm.sh
2013-10-31 18:31:50,886 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,886 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:31:50,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=null
2013-10-31 18:31:50,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46749, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-245661260, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6615452559817063764_1069, duration: 1327501
2013-10-31 18:31:50,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.jar dst=null perm=null
2013-10-31 18:31:50,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49662, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1644234686, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6615452559817063764_1069, duration: 1635618
2013-10-31 18:31:51,727 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_-753643868 given task: attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:52,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=null
2013-10-31 18:31:52,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46753, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 216739
2013-10-31 18:31:52,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:31:52,252 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46754, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 265065
2013-10-31 18:31:52,755 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_1577226638
2013-10-31 18:31:52,755 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_1411612696
2013-10-31 18:31:52,756 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_1577226638 spawned.
2013-10-31 18:31:52,756 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_1411612696 spawned.
2013-10-31 18:31:52,757 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000003_0/taskjvm.sh
2013-10-31 18:31:52,758 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000001_0/taskjvm.sh
2013-10-31 18:31:53,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:53,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:54,152 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_-1990778351 given task: attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:54,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=null
2013-10-31 18:31:54,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46758, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5211779972710902284_1070, duration: 207630
2013-10-31 18:31:54,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:31:54,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47042, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 370402
2013-10-31 18:31:55,145 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:55,145 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0008_m_000005_0
2013-10-31 18:31:55,145 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000005_0 not found in cache
2013-10-31 18:31:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:31:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:31:56,047 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:31:56,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:56,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:56,757 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000. blk_7738361136727118235_1077
2013-10-31 18:31:56,779 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:42869 dest: /127.0.0.1:59471
2013-10-31 18:31:56,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:49673 dest: /127.0.0.1:34578
2013-10-31 18:31:56,782 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002. blk_7731653809023951984_1077
2013-10-31 18:31:56,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:46762 dest: /127.0.0.1:37740
2013-10-31 18:31:56,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:42872 dest: /127.0.0.1:59471
2013-10-31 18:31:56,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7731653809023951984_1077 src: /127.0.0.1:49676 dest: /127.0.0.1:34578
2013-10-31 18:31:56,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7738361136727118235_1077 src: /127.0.0.1:46765 dest: /127.0.0.1:37740
2013-10-31 18:31:56,962 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49676, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 8795253
2013-10-31 18:31:56,964 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,965 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46765, dest: /127.0.0.1:37740, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7738361136727118235_1077, duration: 6599534
2013-10-31 18:31:56,965 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42872, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7731653809023951984_1077, duration: 12098144
2013-10-31 18:31:56,966 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,967 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,968 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49673, dest: /127.0.0.1:34578, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7738361136727118235_1077, duration: 7176237
2013-10-31 18:31:56,970 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46762, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7731653809023951984_1077, duration: 16522125
2013-10-31 18:31:56,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,972 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7731653809023951984_1077 terminating
2013-10-31 18:31:56,972 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42869, dest: /127.0.0.1:59471, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7738361136727118235_1077, duration: 11425124
2013-10-31 18:31:56,970 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,972 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7738361136727118235_1077 terminating
2013-10-31 18:31:56,973 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,974 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:56,974 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:56,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,976 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7738361136727118235_1077 size 260
2013-10-31 18:31:56,976 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7731653809023951984_1077 size 70
2013-10-31 18:31:56,978 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:56,978 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:57,025 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:57,025 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 0.0%
2013-10-31 18:31:57,062 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:57,062 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 0.0%
2013-10-31 18:31:57,744 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_1411612696 given task: attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:57,745 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_1577226638 given task: attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:31:58,182 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:31:58,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=null
2013-10-31 18:31:58,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47053, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5211779972710902284_1070, duration: 137705
2013-10-31 18:31:58,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008/job.split dst=null perm=null
2013-10-31 18:31:58,259 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42880, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5211779972710902284_1070, duration: 205363
2013-10-31 18:31:58,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:31:58,287 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49684, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 155938
2013-10-31 18:31:58,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:31:58,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:58,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:31:59,156 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000000_0
2013-10-31 18:31:59,303 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000002_0
2013-10-31 18:31:59,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:59,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:31:59,901 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49685, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 179146
2013-10-31 18:31:59,902 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003. blk_4349690085078030343_1079
2013-10-31 18:31:59,905 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001. blk_-257311796089327943_1079
2013-10-31 18:31:59,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:42883 dest: /127.0.0.1:59471
2013-10-31 18:31:59,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:49688 dest: /127.0.0.1:34578
2013-10-31 18:31:59,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4349690085078030343_1079 src: /127.0.0.1:46777 dest: /127.0.0.1:37740
2013-10-31 18:31:59,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:49687 dest: /127.0.0.1:34578
2013-10-31 18:31:59,930 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46777, dest: /127.0.0.1:37740, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4349690085078030343_1079, duration: 1678834
2013-10-31 18:31:59,930 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,931 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49688, dest: /127.0.0.1:34578, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4349690085078030343_1079, duration: 2399795
2013-10-31 18:31:59,931 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,931 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:47061 dest: /127.0.0.1:54365
2013-10-31 18:31:59,931 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42883, dest: /127.0.0.1:59471, bytes: 260, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 3382229
2013-10-31 18:31:59,932 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4349690085078030343_1079 terminating
2013-10-31 18:31:59,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-257311796089327943_1079 src: /127.0.0.1:46779 dest: /127.0.0.1:37740
2013-10-31 18:31:59,934 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46779, dest: /127.0.0.1:37740, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-257311796089327943_1079, duration: 1530605
2013-10-31 18:31:59,935 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,935 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4349690085078030343_1079 size 260
2013-10-31 18:31:59,935 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47061, dest: /127.0.0.1:54365, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-257311796089327943_1079, duration: 2279119
2013-10-31 18:31:59,936 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,936 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49687, dest: /127.0.0.1:34578, bytes: 214, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0008_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 3116971
2013-10-31 18:31:59,936 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-257311796089327943_1079 terminating
2013-10-31 18:31:59,937 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,937 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:59,937 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:31:59,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-257311796089327943_1079 size 214
2013-10-31 18:31:59,982 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:31:59,983 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 0.0%
2013-10-31 18:32:00,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0 dst=null perm=null
2013-10-31 18:32:00,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:00,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:00,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000002_0 dst=null perm=null
2013-10-31 18:32:00,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0 dst=null perm=null
2013-10-31 18:32:00,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:00,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:00,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000000_0 dst=null perm=null
2013-10-31 18:32:00,334 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:00,335 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:00,392 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0008_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:00,392 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 0.0%
2013-10-31 18:32:00,613 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:32:00,616 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:32:00,617 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000002_0 is done.
2013-10-31 18:32:00,618 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000002_0 was -1
2013-10-31 18:32:00,618 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:01,264 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:32:01,266 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:32:01,267 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000000_0 is done.
2013-10-31 18:32:01,267 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000000_0 was -1
2013-10-31 18:32:01,267 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:02,160 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000000_0' has completed task_20131031182606197_0008_m_000000 successfully.
2013-10-31 18:32:02,272 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000001_0
2013-10-31 18:32:02,307 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000002_0' has completed task_20131031182606197_0008_m_000002 successfully.
2013-10-31 18:32:02,309 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0008_m_000003_0
2013-10-31 18:32:02,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0 dst=null perm=null
2013-10-31 18:32:02,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:02,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:02,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000003_0 dst=null perm=null
2013-10-31 18:32:02,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0 dst=null perm=null
2013-10-31 18:32:02,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:03,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:03,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary/_attempt_20131031182606197_0008_m_000001_0 dst=null perm=null
2013-10-31 18:32:04,207 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:32:04,209 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:32:04,209 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000003_0 is done.
2013-10-31 18:32:04,209 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000003_0 was -1
2013-10-31 18:32:04,210 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:04,224 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:32:04,226 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:32:04,226 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000001_0 is done.
2013-10-31 18:32:04,227 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000001_0 was -1
2013-10-31 18:32:04,227 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:05,275 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000001_0' has completed task_20131031182606197_0008_m_000001 successfully.
2013-10-31 18:32:05,312 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000003_0' has completed task_20131031182606197_0008_m_000003 successfully.
2013-10-31 18:32:05,317 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0008_m_000004_0' to tip task_20131031182606197_0008_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:05,319 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0008_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:05,319 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0008_m_000004_0 which needs 1 slots
2013-10-31 18:32:05,320 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0008_m_000004_0 which needs 1 slots
2013-10-31 18:32:05,358 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0008_m_775790396
2013-10-31 18:32:05,358 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0008_m_775790396 spawned.
2013-10-31 18:32:05,361 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0008/attempt_20131031182606197_0008_m_000004_0/taskjvm.sh
2013-10-31 18:32:06,608 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0008_m_775790396 given task: attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,094 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000004_0 0.0%
2013-10-31 18:32:07,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_temporary dst=null perm=null
2013-10-31 18:32:07,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:07,113 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS from client DFSClient_attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,114 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0008_m_000004_0
2013-10-31 18:32:07,117 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,117 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6615452559817063764 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5211779972710902284 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8801034186855298322 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:07,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:07,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:07,119 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2565033199268478674 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:07,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0008 dst=null perm=null
2013-10-31 18:32:07,391 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_-6615452559817063764_1069
2013-10-31 18:32:07,391 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:08,022 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data3/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:08,022 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data3/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:08,022 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data3/current/blk_-8801034186855298322
2013-10-31 18:32:08,023 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data4/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:08,023 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data3/current/blk_-6615452559817063764
2013-10-31 18:32:08,023 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data4/current/blk_-5211779972710902284
2013-10-31 18:32:09,221 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data7/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:09,221 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data7/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:09,221 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data7/current/blk_-8801034186855298322
2013-10-31 18:32:09,221 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data8/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:09,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data8/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:09,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data8/current/blk_-5211779972710902284
2013-10-31 18:32:09,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data7/current/blk_-6615452559817063764
2013-10-31 18:32:09,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data8/current/blk_2565033199268478674
2013-10-31 18:32:10,029 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0008_m_000004_0 0.0% cleanup
2013-10-31 18:32:10,031 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0008_m_000004_0 is done.
2013-10-31 18:32:10,031 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0008_m_000004_0 was -1
2013-10-31 18:32:10,031 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:10,391 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-5211779972710902284_1070 blk_-8801034186855298322_1071 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:10,392 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-5211779972710902284_1070 blk_2565033199268478674_1072 blk_-6615452559817063764_1069
2013-10-31 18:32:11,327 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0008_m_000004_0' has completed task_20131031182606197_0008_m_000004 successfully.
2013-10-31 18:32:11,328 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0008 has completed successfully.
2013-10-31 18:32:11,329 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0008,submitTime=1383244303088,launchTime=1383244303239,firstMapTaskLaunchTime=1383244310141,firstJobSetupTaskLaunchTime=1383244304123,firstJobCleanupTaskLaunchTime=1383244325316,finishTime=1383244331328,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=54,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/537D50CF9A3B40BCBDC85E14863FF241] left+right/(1/3)
2013-10-31 18:32:11,335 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC. blk_-8232283085439151097_1080
2013-10-31 18:32:11,336 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:42892 dest: /127.0.0.1:59471
2013-10-31 18:32:11,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:47067 dest: /127.0.0.1:54365
2013-10-31 18:32:11,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8232283085439151097_1080 src: /127.0.0.1:46785 dest: /127.0.0.1:37740
2013-10-31 18:32:11,351 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46785, dest: /127.0.0.1:37740, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8232283085439151097_1080, duration: 11515230
2013-10-31 18:32:11,352 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,353 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47067, dest: /127.0.0.1:54365, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8232283085439151097_1080, duration: 3447460
2013-10-31 18:32:11,353 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,354 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42892, dest: /127.0.0.1:59471, bytes: 22431, op: HDFS_WRITE, cliID: DFSClient_786869453, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8232283085439151097_1080, duration: 14366345
2013-10-31 18:32:11,354 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,354 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8232283085439151097_1080 terminating
2013-10-31 18:32:11,357 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC from client DFSClient_786869453
2013-10-31 18:32:11,357 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/_logs/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC is closed by DFSClient_786869453
2013-10-31 18:32:11,357 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,358 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8232283085439151097_1080 size 22431
2013-10-31 18:32:11,362 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0008_1383244303088_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F537D50CF9A3B40BC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:11,363 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000003_0'
2013-10-31 18:32:11,363 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000004_0'
2013-10-31 18:32:11,363 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:11,363 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:11,363 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3249008124411573785 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:11,367 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0008_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:11,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0008 dst=null perm=null
2013-10-31 18:32:11,368 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/3) ...pesplatform/nonsafesplit2
2013-10-31 18:32:11,368 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (3/3) ...pesplatform/nonsafesplit1
2013-10-31 18:32:11,372 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:11,372 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:32:11,372 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:11,372 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:32:11,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:11,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:11,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:32:11,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:32:11,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,520 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar. blk_1765133373633960270_1082
2013-10-31 18:32:11,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:49699 dest: /127.0.0.1:34578
2013-10-31 18:32:11,522 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:47071 dest: /127.0.0.1:54365
2013-10-31 18:32:11,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,522 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:46789 dest: /127.0.0.1:37740
2013-10-31 18:32:11,553 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46789, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1765133373633960270_1082, duration: 27449484
2013-10-31 18:32:11,554 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47071, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 29183615
2013-10-31 18:32:11,556 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,557 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49699, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1765133373633960270_1082, duration: 31447632
2013-10-31 18:32:11,558 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,558 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1765133373633960270_1082 terminating
2013-10-31 18:32:11,561 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,561 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:11,562 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:11,562 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:11,567 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar. blk_-4134747532649829860_1082
2013-10-31 18:32:11,568 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar. New replication is 10
2013-10-31 18:32:11,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:46790 dest: /127.0.0.1:37740
2013-10-31 18:32:11,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:42900 dest: /127.0.0.1:59471
2013-10-31 18:32:11,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=null
2013-10-31 18:32:11,572 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:49704 dest: /127.0.0.1:34578
2013-10-31 18:32:11,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,588 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:11,594 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49704, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4134747532649829860_1082, duration: 19885564
2013-10-31 18:32:11,595 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42900, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 21878435
2013-10-31 18:32:11,598 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,600 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=null
2013-10-31 18:32:11,604 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46790, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 18069065
2013-10-31 18:32:11,604 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4134747532649829860_1082 terminating
2013-10-31 18:32:11,612 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:11,613 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:11,613 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:11,614 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:11,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000 dst=null perm=null
2013-10-31 18:32:11,617 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar. New replication is 10
2013-10-31 18:32:11,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=null
2013-10-31 18:32:11,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001 dst=null perm=null
2013-10-31 18:32:11,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,627 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:11,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002 dst=null perm=null
2013-10-31 18:32:11,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003 dst=null perm=null
2013-10-31 18:32:11,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=null
2013-10-31 18:32:11,634 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:11,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000 dst=null perm=null
2013-10-31 18:32:11,639 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split. New replication is 10
2013-10-31 18:32:11,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=null
2013-10-31 18:32:11,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001 dst=null perm=null
2013-10-31 18:32:11,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002 dst=null perm=null
2013-10-31 18:32:11,645 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split. blk_7445994968599272333_1083
2013-10-31 18:32:11,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003 dst=null perm=null
2013-10-31 18:32:11,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:47076 dest: /127.0.0.1:54365
2013-10-31 18:32:11,647 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:42903 dest: /127.0.0.1:59471
2013-10-31 18:32:11,648 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:49707 dest: /127.0.0.1:34578
2013-10-31 18:32:11,649 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7445994968599272333_1083 src: /127.0.0.1:46796 dest: /127.0.0.1:37740
2013-10-31 18:32:11,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,653 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46796, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7445994968599272333_1083, duration: 723900
2013-10-31 18:32:11,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,655 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49707, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7445994968599272333_1083, duration: 1741919
2013-10-31 18:32:11,655 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,656 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42903, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7445994968599272333_1083, duration: 3313294
2013-10-31 18:32:11,656 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,656 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,657 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47076, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7445994968599272333_1083, duration: 4717371
2013-10-31 18:32:11,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,658 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7445994968599272333_1083 terminating
2013-10-31 18:32:11,657 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,660 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split from client DFSClient_-1596270109
2013-10-31 18:32:11,660 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:11,661 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7445994968599272333_1083 size 1387
2013-10-31 18:32:11,666 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split. New replication is 10
2013-10-31 18:32:11,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=null
2013-10-31 18:32:11,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,677 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split. blk_-8036407782984700833_1085
2013-10-31 18:32:11,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:49709 dest: /127.0.0.1:34578
2013-10-31 18:32:11,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:47081 dest: /127.0.0.1:54365
2013-10-31 18:32:11,682 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:42908 dest: /127.0.0.1:59471
2013-10-31 18:32:11,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036407782984700833_1085 src: /127.0.0.1:46800 dest: /127.0.0.1:37740
2013-10-31 18:32:11,684 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo. blk_-4081485762383124586_1085
2013-10-31 18:32:11,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:42910 dest: /127.0.0.1:59471
2013-10-31 18:32:11,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46800, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 946166
2013-10-31 18:32:11,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,690 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42908, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8036407782984700833_1085, duration: 2550085
2013-10-31 18:32:11,691 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:47085 dest: /127.0.0.1:54365
2013-10-31 18:32:11,691 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47081, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 4594248
2013-10-31 18:32:11,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,694 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,694 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49709, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036407782984700833_1085, duration: 6622570
2013-10-31 18:32:11,695 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,695 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8036407782984700833_1085 terminating
2013-10-31 18:32:11,697 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4081485762383124586_1085 src: /127.0.0.1:46803 dest: /127.0.0.1:37740
2013-10-31 18:32:11,697 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,700 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8036407782984700833_1085 size 1387
2013-10-31 18:32:11,701 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split from client DFSClient_-1596270109
2013-10-31 18:32:11,701 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:11,706 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46803, dest: /127.0.0.1:37740, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4081485762383124586_1085, duration: 942881
2013-10-31 18:32:11,706 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,707 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,708 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47085, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4081485762383124586_1085, duration: 2978454
2013-10-31 18:32:11,708 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,708 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,711 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42910, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4081485762383124586_1085, duration: 5943933
2013-10-31 18:32:11,712 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4081485762383124586_1085 terminating
2013-10-31 18:32:11,715 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4081485762383124586_1085 size 153
2013-10-31 18:32:11,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:11,718 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:11,719 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:11,752 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data6/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:11,752 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data5/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:11,752 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data6/current/blk_-6615452559817063764
2013-10-31 18:32:11,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data6/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:11,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data5/current/blk_-5211779972710902284
2013-10-31 18:32:11,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data6/current/blk_2565033199268478674
2013-10-31 18:32:12,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8801034186855298322_1071 file build/test/data/dfs/data/data2/current/blk_-8801034186855298322 for deletion
2013-10-31 18:32:12,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6615452559817063764_1069 file build/test/data/dfs/data/data2/current/blk_-6615452559817063764 for deletion
2013-10-31 18:32:12,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8801034186855298322_1071 at file build/test/data/dfs/data/data2/current/blk_-8801034186855298322
2013-10-31 18:32:12,149 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5211779972710902284_1070 file build/test/data/dfs/data/data1/current/blk_-5211779972710902284 for deletion
2013-10-31 18:32:12,150 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6615452559817063764_1069 at file build/test/data/dfs/data/data2/current/blk_-6615452559817063764
2013-10-31 18:32:12,150 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5211779972710902284_1070 at file build/test/data/dfs/data/data1/current/blk_-5211779972710902284
2013-10-31 18:32:12,150 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2565033199268478674_1072 file build/test/data/dfs/data/data1/current/blk_2565033199268478674 for deletion
2013-10-31 18:32:12,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2565033199268478674_1072 at file build/test/data/dfs/data/data1/current/blk_2565033199268478674
2013-10-31 18:32:13,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,206 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo. blk_-6246259349516176919_1087
2013-10-31 18:32:13,207 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:42913 dest: /127.0.0.1:59471
2013-10-31 18:32:13,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:46805 dest: /127.0.0.1:37740
2013-10-31 18:32:13,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6246259349516176919_1087 src: /127.0.0.1:49718 dest: /127.0.0.1:34578
2013-10-31 18:32:13,215 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49718, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6246259349516176919_1087, duration: 1031960
2013-10-31 18:32:13,215 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,217 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46805, dest: /127.0.0.1:37740, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6246259349516176919_1087, duration: 2800464
2013-10-31 18:32:13,217 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,219 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42913, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6246259349516176919_1087, duration: 4930614
2013-10-31 18:32:13,219 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,220 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6246259349516176919_1087 terminating
2013-10-31 18:32:13,221 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,222 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:13,222 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:13,224 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6246259349516176919_1087 size 153
2013-10-31 18:32:13,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,238 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml. blk_-4993244343269496237_1088
2013-10-31 18:32:13,240 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:47090 dest: /127.0.0.1:54365
2013-10-31 18:32:13,242 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:49720 dest: /127.0.0.1:34578
2013-10-31 18:32:13,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,244 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4993244343269496237_1088 src: /127.0.0.1:46809 dest: /127.0.0.1:37740
2013-10-31 18:32:13,248 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46809, dest: /127.0.0.1:37740, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 864255
2013-10-31 18:32:13,248 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,249 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49720, dest: /127.0.0.1:34578, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4993244343269496237_1088, duration: 2366174
2013-10-31 18:32:13,250 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,251 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47090, dest: /127.0.0.1:54365, bytes: 27817, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4993244343269496237_1088, duration: 3962291
2013-10-31 18:32:13,251 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4993244343269496237_1088 terminating
2013-10-31 18:32:13,253 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,253 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:13,254 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:13,254 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,256 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4993244343269496237_1088 size 27817
2013-10-31 18:32:13,260 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml. blk_3808353552338567285_1088
2013-10-31 18:32:13,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=null
2013-10-31 18:32:13,270 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46811, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 404687
2013-10-31 18:32:13,289 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0009: nMaps=4 nReduces=0 max=-1
2013-10-31 18:32:13,290 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0009 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:13,290 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0009
2013-10-31 18:32:13,290 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0009 RESULT=SUCCESS
2013-10-31 18:32:13,290 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0009
2013-10-31 18:32:13,291 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0009
2013-10-31 18:32:13,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:42921 dest: /127.0.0.1:59471
2013-10-31 18:32:13,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:46813 dest: /127.0.0.1:37740
2013-10-31 18:32:13,304 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3808353552338567285_1088 src: /127.0.0.1:47097 dest: /127.0.0.1:54365
2013-10-31 18:32:13,309 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47097, dest: /127.0.0.1:54365, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3808353552338567285_1088, duration: 1951689
2013-10-31 18:32:13,309 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46813, dest: /127.0.0.1:37740, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3808353552338567285_1088, duration: 3440430
2013-10-31 18:32:13,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,312 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42921, dest: /127.0.0.1:59471, bytes: 27813, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 5644292
2013-10-31 18:32:13,313 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,313 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3808353552338567285_1088 terminating
2013-10-31 18:32:13,316 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:13,316 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:13,318 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3808353552338567285_1088 size 27813
2013-10-31 18:32:13,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=null
2013-10-31 18:32:13,332 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml. blk_1249157363671041976_1090
2013-10-31 18:32:13,333 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42925, bytes: 28033, op: HDFS_READ, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 401445
2013-10-31 18:32:13,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:47100 dest: /127.0.0.1:54365
2013-10-31 18:32:13,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:49730 dest: /127.0.0.1:34578
2013-10-31 18:32:13,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1249157363671041976_1090 src: /127.0.0.1:46819 dest: /127.0.0.1:37740
2013-10-31 18:32:13,343 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46819, dest: /127.0.0.1:37740, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1249157363671041976_1090, duration: 2287511
2013-10-31 18:32:13,344 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,345 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,345 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49730, dest: /127.0.0.1:34578, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1249157363671041976_1090, duration: 4261506
2013-10-31 18:32:13,345 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,347 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47100, dest: /127.0.0.1:54365, bytes: 27882, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1249157363671041976_1090, duration: 5969162
2013-10-31 18:32:13,347 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1249157363671041976_1090 terminating
2013-10-31 18:32:13,349 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,349 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml from client DFSClient_-636476314
2013-10-31 18:32:13,350 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_conf.xml is closed by DFSClient_-636476314
2013-10-31 18:32:13,351 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1249157363671041976_1090 size 27882
2013-10-31 18:32:13,358 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0010: nMaps=4 nReduces=0 max=-1
2013-10-31 18:32:13,358 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0010 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:13,359 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0010
2013-10-31 18:32:13,359 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0010 RESULT=SUCCESS
2013-10-31 18:32:13,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,359 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0010
2013-10-31 18:32:13,361 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken. blk_-6152330823190221756_1091
2013-10-31 18:32:13,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:47104 dest: /127.0.0.1:54365
2013-10-31 18:32:13,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:42931 dest: /127.0.0.1:59471
2013-10-31 18:32:13,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6152330823190221756_1091 src: /127.0.0.1:49735 dest: /127.0.0.1:34578
2013-10-31 18:32:13,371 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0010
2013-10-31 18:32:13,371 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49735, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 982825
2013-10-31 18:32:13,372 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42931, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6152330823190221756_1091, duration: 2958678
2013-10-31 18:32:13,373 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,373 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,375 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,375 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47104, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6152330823190221756_1091, duration: 4992183
2013-10-31 18:32:13,376 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6152330823190221756_1091 terminating
2013-10-31 18:32:13,377 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:13,378 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:13,380 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6152330823190221756_1091 size 116
2013-10-31 18:32:13,392 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-4134747532649829860_1082 to datanode(s) 127.0.0.1:54365
2013-10-31 18:32:13,393 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_1765133373633960270_1082 to datanode(s) 127.0.0.1:59471
2013-10-31 18:32:13,394 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_3249008124411573785_1075
2013-10-31 18:32:13,394 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_3249008124411573785_1075
2013-10-31 18:32:13,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,615 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken
2013-10-31 18:32:13,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.splitmetainfo dst=null perm=null
2013-10-31 18:32:13,620 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47107, bytes: 157, op: HDFS_READ, cliID: DFSClient_-636476314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4081485762383124586_1085, duration: 285911
2013-10-31 18:32:13,621 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0009 = 804. Number of splits = 4
2013-10-31 18:32:13,621 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,621 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,621 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,622 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,623 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,624 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0009_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,624 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0009 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:13,624 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0009 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:32:13,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,637 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml. blk_-2757987895680919733_1093
2013-10-31 18:32:13,639 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:42934 dest: /127.0.0.1:59471
2013-10-31 18:32:13,640 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:47109 dest: /127.0.0.1:54365
2013-10-31 18:32:13,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2757987895680919733_1093 src: /127.0.0.1:49739 dest: /127.0.0.1:34578
2013-10-31 18:32:13,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49739, dest: /127.0.0.1:34578, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2757987895680919733_1093, duration: 3924459
2013-10-31 18:32:13,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,651 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47109, dest: /127.0.0.1:54365, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2757987895680919733_1093, duration: 5486889
2013-10-31 18:32:13,652 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,653 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42934, dest: /127.0.0.1:59471, bytes: 27878, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2757987895680919733_1093, duration: 7046751
2013-10-31 18:32:13,653 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2757987895680919733_1093 terminating
2013-10-31 18:32:13,655 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,655 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml from client DFSClient_-1859484039
2013-10-31 18:32:13,656 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_conf.xml is closed by DFSClient_-1859484039
2013-10-31 18:32:13,656 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2757987895680919733_1093 size 27878
2013-10-31 18:32:13,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:13,671 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken. blk_726165482891072064_1094
2013-10-31 18:32:13,673 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:46828 dest: /127.0.0.1:37740
2013-10-31 18:32:13,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:42938 dest: /127.0.0.1:59471
2013-10-31 18:32:13,676 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_726165482891072064_1094 src: /127.0.0.1:49742 dest: /127.0.0.1:34578
2013-10-31 18:32:13,679 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49742, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_726165482891072064_1094, duration: 821250
2013-10-31 18:32:13,680 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,682 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42938, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 3543607
2013-10-31 18:32:13,683 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46828, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_726165482891072064_1094, duration: 4654132
2013-10-31 18:32:13,684 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_726165482891072064_1094 terminating
2013-10-31 18:32:13,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_726165482891072064_1094 size 116
2013-10-31 18:32:13,688 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:13,688 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:13,693 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken
2013-10-31 18:32:13,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.splitmetainfo dst=null perm=null
2013-10-31 18:32:13,698 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42940, bytes: 157, op: HDFS_READ, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6246259349516176919_1087, duration: 283860
2013-10-31 18:32:13,699 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0010 = 804. Number of splits = 4
2013-10-31 18:32:13,699 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,699 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,700 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,701 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0010_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:13,702 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0010 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:13,702 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0010 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:32:14,176 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0009_m_000005_0' to tip task_20131031182606197_0009_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:14,180 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000000_0'
2013-10-31 18:32:14,180 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000005_0'
2013-10-31 18:32:14,182 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:14,182 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,182 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken dst=null perm=null
2013-10-31 18:32:14,191 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49744, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 304159
2013-10-31 18:32:14,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=null
2013-10-31 18:32:14,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49746, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-1486956122, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4993244343269496237_1088, duration: 396477
2013-10-31 18:32:14,236 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:14,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=null
2013-10-31 18:32:14,269 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47118, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1486956122, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 1412338
2013-10-31 18:32:14,290 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0010_m_000005_0' to tip task_20131031182606197_0010_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:14,296 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000001_0'
2013-10-31 18:32:14,298 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:14,298 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,298 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000005_0 which needs 1 slots
2013-10-31 18:32:14,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken dst=null perm=null
2013-10-31 18:32:14,307 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42945, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 384423
2013-10-31 18:32:14,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=null
2013-10-31 18:32:14,317 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47121, bytes: 28033, op: HDFS_READ, cliID: DFSClient_-478108362, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3808353552338567285_1088, duration: 393343
2013-10-31 18:32:14,320 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0008_m_000002_0'
2013-10-31 18:32:14,330 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:14,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=null
2013-10-31 18:32:14,347 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46839, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-478108362, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 683580
2013-10-31 18:32:14,420 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0008_m_966824357
2013-10-31 18:32:14,429 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21103 with signal TERM. Exit code 0
2013-10-31 18:32:14,430 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_1297381535
2013-10-31 18:32:14,431 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_1297381535 spawned.
2013-10-31 18:32:14,433 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000005_0/taskjvm.sh
2013-10-31 18:32:14,499 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_476228411
2013-10-31 18:32:14,500 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_476228411 spawned.
2013-10-31 18:32:14,501 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000005_0/taskjvm.sh
2013-10-31 18:32:14,578 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0008_m_966824357
2013-10-31 18:32:14,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data5/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:14,753 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data5/current/blk_3249008124411573785
2013-10-31 18:32:15,010 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:15,010 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:15,010 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:15,011 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_966824357 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:15,222 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-4134747532649829860_1082 to 127.0.0.1:54365
2013-10-31 18:32:15,222 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_1765133373633960270_1082 to 127.0.0.1:59471
2013-10-31 18:32:15,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data8/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:15,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data8/current/blk_3249008124411573785
2013-10-31 18:32:15,223 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-4134747532649829860_1082 to /127.0.0.1:54365
2013-10-31 18:32:15,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1765133373633960270_1082 src: /127.0.0.1:42949 dest: /127.0.0.1:59471
2013-10-31 18:32:15,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4134747532649829860_1082 src: /127.0.0.1:47123 dest: /127.0.0.1:54365
2013-10-31 18:32:15,223 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_1765133373633960270_1082 to /127.0.0.1:59471
2013-10-31 18:32:15,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1765133373633960270_1082 src: /127.0.0.1:42949 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:32:15,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4134747532649829860_1082 src: /127.0.0.1:47123 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:32:15,226 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4134747532649829860_1082 size 238055
2013-10-31 18:32:15,228 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1765133373633960270_1082 size 238055
2013-10-31 18:32:15,695 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1297381535 given task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:15,753 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_476228411 given task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:16,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:16,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:16,363 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:16,364 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000004_0 not found in cache
2013-10-31 18:32:16,364 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000003_0 not found in cache
2013-10-31 18:32:16,365 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330736364
2013-10-31 18:32:16,395 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_3249008124411573785_1075
2013-10-31 18:32:16,601 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_775790396 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:16,612 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21633 with signal TERM. Exit code 0
2013-10-31 18:32:16,739 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_1577226638 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:16,744 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21485 with signal TERM. Exit code 0
2013-10-31 18:32:16,775 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:16,775 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:16,775 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:16,775 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_775790396 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:16,919 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:16,920 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:16,920 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:16,920 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_1577226638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:18,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3249008124411573785_1075 file build/test/data/dfs/data/data1/current/blk_3249008124411573785 for deletion
2013-10-31 18:32:18,151 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3249008124411573785_1075 at file build/test/data/dfs/data/data1/current/blk_3249008124411573785
2013-10-31 18:32:19,115 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000005_0 0.0% setup
2013-10-31 18:32:19,118 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000005_0 is done.
2013-10-31 18:32:19,118 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000005_0 was -1
2013-10-31 18:32:19,118 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:19,177 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000005_0 0.0% setup
2013-10-31 18:32:19,180 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000005_0 is done.
2013-10-31 18:32:19,180 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000005_0 was -1
2013-10-31 18:32:19,180 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:19,182 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,183 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000000_0 not found in cache
2013-10-31 18:32:19,184 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739183
2013-10-31 18:32:19,298 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,299 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000001_0 not found in cache
2013-10-31 18:32:19,299 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739299
2013-10-31 18:32:19,321 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0008
2013-10-31 18:32:19,321 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0008_m_000002_0 not found in cache
2013-10-31 18:32:19,322 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0008 for user-log deletion with retainTimeStamp:1383330739321
2013-10-31 18:32:19,815 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_-753643868 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:19,820 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0008_m_1411612696 since job job_20131031182606197_0008 is dead
2013-10-31 18:32:19,827 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21326 with signal TERM. Exit code 0
2013-10-31 18:32:19,831 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21484 with signal TERM. Exit code 0
2013-10-31 18:32:20,001 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,001 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,001 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,001 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,001 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:20,001 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:20,001 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_1411612696 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,001 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_-753643868 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,188 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000005_0' has completed task_20131031182606197_0009_m_000005 successfully.
2013-10-31 18:32:20,192 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000000_0' to tip task_20131031182606197_0009_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:20,193 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000000
2013-10-31 18:32:20,195 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:20,195 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,195 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,226 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_759702916
2013-10-31 18:32:20,226 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_759702916 spawned.
2013-10-31 18:32:20,228 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000000_0/taskjvm.sh
2013-10-31 18:32:20,305 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000005_0' has completed task_20131031182606197_0010_m_000005 successfully.
2013-10-31 18:32:20,311 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000001_0' to tip task_20131031182606197_0009_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:20,311 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000001
2013-10-31 18:32:20,312 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000002_0' to tip task_20131031182606197_0009_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:20,313 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000002
2013-10-31 18:32:20,315 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:20,316 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:20,316 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,316 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,317 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,317 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0009_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,326 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0009_m_000003_0' to tip task_20131031182606197_0009_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:20,327 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0009_m_000003
2013-10-31 18:32:20,329 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000000_0' to tip task_20131031182606197_0010_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:20,331 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000000
2013-10-31 18:32:20,333 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:20,334 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:20,334 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000003_0 which needs 1 slots
2013-10-31 18:32:20,334 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000003_0 which needs 1 slots
2013-10-31 18:32:20,335 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,335 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000000_0 which needs 1 slots
2013-10-31 18:32:20,372 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000001_0' to tip task_20131031182606197_0010_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:20,372 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000001
2013-10-31 18:32:20,373 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000002_0' to tip task_20131031182606197_0010_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:20,373 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000002
2013-10-31 18:32:20,375 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:20,376 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:20,376 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,376 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000001_0 which needs 1 slots
2013-10-31 18:32:20,377 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,377 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000002_0 which needs 1 slots
2013-10-31 18:32:20,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken dst=null perm=null
2013-10-31 18:32:20,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken dst=null perm=null
2013-10-31 18:32:20,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken dst=null perm=null
2013-10-31 18:32:20,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009/jobToken dst=null perm=null
2013-10-31 18:32:20,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42957, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 149669
2013-10-31 18:32:20,475 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47129, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6152330823190221756_1091, duration: 384572
2013-10-31 18:32:20,475 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46847, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_726165482891072064_1094, duration: 383232
2013-10-31 18:32:20,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=null
2013-10-31 18:32:20,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=null
2013-10-31 18:32:20,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=null
2013-10-31 18:32:20,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42961, bytes: 28033, op: HDFS_READ, cliID: DFSClient_1284330603, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 412382
2013-10-31 18:32:20,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47136, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-575752910, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4993244343269496237_1088, duration: 421524
2013-10-31 18:32:20,490 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42963, bytes: 28033, op: HDFS_READ, cliID: DFSClient_708408331, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 1203168
2013-10-31 18:32:20,514 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49767, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6152330823190221756_1091, duration: 293915
2013-10-31 18:32:20,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.xml dst=null perm=null
2013-10-31 18:32:20,525 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,525 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,525 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46857, bytes: 28037, op: HDFS_READ, cliID: DFSClient_-754400775, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4993244343269496237_1088, duration: 411235
2013-10-31 18:32:20,549 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:20,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=null
2013-10-31 18:32:20,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=null
2013-10-31 18:32:20,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=null
2013-10-31 18:32:20,552 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42967, bytes: 239915, op: HDFS_READ, cliID: DFSClient_708408331, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 683915
2013-10-31 18:32:20,552 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42969, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-575752910, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1765133373633960270_1082, duration: 724074
2013-10-31 18:32:20,552 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46859, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1284330603, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4134747532649829860_1082, duration: 812257
2013-10-31 18:32:20,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.jar dst=null perm=null
2013-10-31 18:32:20,563 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47144, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-754400775, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1765133373633960270_1082, duration: 670477
2013-10-31 18:32:20,633 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_1371704024
2013-10-31 18:32:20,633 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_-1788039440
2013-10-31 18:32:20,634 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_1371704024 spawned.
2013-10-31 18:32:20,635 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_-1788039440 spawned.
2013-10-31 18:32:20,635 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_-1154774997
2013-10-31 18:32:20,635 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_1071625860
2013-10-31 18:32:20,636 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_-1154774997 spawned.
2013-10-31 18:32:20,637 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_1071625860 spawned.
2013-10-31 18:32:20,637 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0010_m_476228411
2013-10-31 18:32:20,639 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000002_0/taskjvm.sh
2013-10-31 18:32:20,639 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000000_0/taskjvm.sh
2013-10-31 18:32:20,640 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000001_0/taskjvm.sh
2013-10-31 18:32:20,640 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000001_0/taskjvm.sh
2013-10-31 18:32:20,643 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21887 with signal TERM. Exit code 0
2013-10-31 18:32:20,643 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_-760035825
2013-10-31 18:32:20,644 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_-760035825 spawned.
2013-10-31 18:32:20,644 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:32:20,645 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000002_0/taskjvm.sh
2013-10-31 18:32:20,648 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21416 with signal TERM. Exit code 0
2013-10-31 18:32:20,648 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0009_m_1345701271
2013-10-31 18:32:20,650 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0009_m_1345701271 spawned.
2013-10-31 18:32:20,652 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0009/attempt_20131031182606197_0009_m_000003_0/taskjvm.sh
2013-10-31 18:32:20,668 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0008_m_-1990778351
2013-10-31 18:32:20,725 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,725 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,725 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:20,726 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_476228411 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:20,810 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:20,810 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:20,810 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:20,811 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0008_m_-1990778351 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:21,306 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_759702916 given task: attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:21,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=null
2013-10-31 18:32:21,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47147, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7445994968599272333_1083, duration: 170437
2013-10-31 18:32:21,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000 dst=null perm=null
2013-10-31 18:32:21,904 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46865, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7738361136727118235_1077, duration: 261530
2013-10-31 18:32:23,198 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0010_m_000003_0' to tip task_20131031182606197_0010_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:23,199 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0010_m_000003
2013-10-31 18:32:23,202 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:23,203 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000003_0 which needs 1 slots
2013-10-31 18:32:23,203 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0010_m_000003_0 which needs 1 slots
2013-10-31 18:32:23,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010/jobToken dst=null perm=null
2013-10-31 18:32:23,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42975, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_726165482891072064_1094, duration: 307390
2013-10-31 18:32:23,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.xml dst=null perm=null
2013-10-31 18:32:23,224 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42977, bytes: 28033, op: HDFS_READ, cliID: DFSClient_1355569340, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3808353552338567285_1088, duration: 408509
2013-10-31 18:32:23,250 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:23,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.jar dst=null perm=null
2013-10-31 18:32:23,285 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:42978, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1355569340, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4134747532649829860_1082, duration: 1608698
2013-10-31 18:32:25,195 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:25,196 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0009_m_000005_0
2013-10-31 18:32:25,196 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000005_0 not found in cache
2013-10-31 18:32:25,316 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:25,317 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0010_m_000005_0
2013-10-31 18:32:25,317 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000005_0 not found in cache
2013-10-31 18:32:27,345 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0009_m_1297381535
2013-10-31 18:32:27,352 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group21857 with signal TERM. Exit code 0
2013-10-31 18:32:27,353 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:27,354 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0010_m_-775097629 spawned.
2013-10-31 18:32:27,355 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0010/attempt_20131031182606197_0010_m_000003_0/taskjvm.sh
2013-10-31 18:32:27,435 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:27,435 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:27,435 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:27,436 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_1297381535 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:27,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:27,574 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 492 Total time for transactions(ms): 11Number of transactions batched in Syncs: 21 Number of syncs: 339 SyncTimes(ms): 49177 10498
2013-10-31 18:32:27,800 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:27,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:28,016 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000. blk_-5467518339498007322_1095
2013-10-31 18:32:28,053 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:47154 dest: /127.0.0.1:54365
2013-10-31 18:32:28,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:42981 dest: /127.0.0.1:59471
2013-10-31 18:32:28,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5467518339498007322_1095 src: /127.0.0.1:46873 dest: /127.0.0.1:37740
2013-10-31 18:32:28,058 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46873, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5467518339498007322_1095, duration: 1882527
2013-10-31 18:32:28,058 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,059 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42981, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5467518339498007322_1095, duration: 2485109
2013-10-31 18:32:28,059 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,059 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47154, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5467518339498007322_1095, duration: 3131289
2013-10-31 18:32:28,060 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,060 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5467518339498007322_1095 terminating
2013-10-31 18:32:28,061 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,061 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5467518339498007322_1095 size 176
2013-10-31 18:32:28,063 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:28,063 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:28,109 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:28,109 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:28,380 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_1371704024 given task: attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:28,740 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-1788039440 given task: attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:28,754 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_-760035825 given task: attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:28,782 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_1071625860 given task: attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:28,785 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-775097629 given task: attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:28,788 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_-1154774997 given task: attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:28,789 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1345701271 given task: attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:28,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=null
2013-10-31 18:32:28,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47165, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 269632
2013-10-31 18:32:28,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001 dst=null perm=null
2013-10-31 18:32:28,981 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49795, bytes: 218, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 162711
2013-10-31 18:32:29,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:29,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:29,200 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002. blk_3055933182081159268_1096
2013-10-31 18:32:29,207 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000000_0
2013-10-31 18:32:29,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:42994 dest: /127.0.0.1:59471
2013-10-31 18:32:29,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:49799 dest: /127.0.0.1:34578
2013-10-31 18:32:29,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3055933182081159268_1096 src: /127.0.0.1:47171 dest: /127.0.0.1:54365
2013-10-31 18:32:29,228 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47171, dest: /127.0.0.1:54365, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3055933182081159268_1096, duration: 1266398
2013-10-31 18:32:29,228 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,228 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49799, dest: /127.0.0.1:34578, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3055933182081159268_1096, duration: 1737902
2013-10-31 18:32:29,229 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,229 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:42994, dest: /127.0.0.1:59471, bytes: 130, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0010_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3055933182081159268_1096, duration: 2136246
2013-10-31 18:32:29,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,229 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3055933182081159268_1096 terminating
2013-10-31 18:32:29,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,230 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,230 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,231 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3055933182081159268_1096 size 130
2013-10-31 18:32:29,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=null
2013-10-31 18:32:29,284 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49804, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7445994968599272333_1083, duration: 179350
2013-10-31 18:32:29,292 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:29,292 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000002_0 0.0%
2013-10-31 18:32:29,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=null
2013-10-31 18:32:29,307 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46894, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 177282
2013-10-31 18:32:29,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=null
2013-10-31 18:32:29,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001 dst=null perm=null
2013-10-31 18:32:29,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010/job.split dst=null perm=null
2013-10-31 18:32:29,322 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47178, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8036407782984700833_1085, duration: 180220
2013-10-31 18:32:29,322 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49808, bytes: 218, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-257311796089327943_1079, duration: 125668
2013-10-31 18:32:29,325 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46897, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036407782984700833_1085, duration: 110732
2013-10-31 18:32:29,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000 dst=null perm=null
2013-10-31 18:32:29,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=null
2013-10-31 18:32:29,346 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49810, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7738361136727118235_1077, duration: 132877
2013-10-31 18:32:29,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:29,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43008, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7445994968599272333_1083, duration: 142216
2013-10-31 18:32:29,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:29,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003 dst=null perm=null
2013-10-31 18:32:29,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002 dst=null perm=null
2013-10-31 18:32:29,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43009, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 141281
2013-10-31 18:32:29,362 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49813, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0010_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 109520
2013-10-31 18:32:29,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009/job.split dst=null perm=null
2013-10-31 18:32:29,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003 dst=null perm=null
2013-10-31 18:32:29,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46902, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7445994968599272333_1083, duration: 130107
2013-10-31 18:32:29,384 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000002_0
2013-10-31 18:32:29,387 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43012, bytes: 264, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4349690085078030343_1079, duration: 133121
2013-10-31 18:32:29,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002 dst=null perm=null
2013-10-31 18:32:29,420 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49816, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0009_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7731653809023951984_1077, duration: 107177
2013-10-31 18:32:30,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0 dst=null perm=null
2013-10-31 18:32:30,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0 dst=null perm=null
2013-10-31 18:32:30,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:30,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,023 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:31,024 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:31,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:31,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000000_0 dst=null perm=null
2013-10-31 18:32:31,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000002_0 dst=null perm=null
2013-10-31 18:32:31,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:31,250 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,250 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 0.0%
2013-10-31 18:32:31,381 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:31,381 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:31,396 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:31,397 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:31,402 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:31,402 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:31,403 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001. blk_8597259860310358460_1102
2013-10-31 18:32:31,407 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:31,407 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:31,428 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,429 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0%
2013-10-31 18:32:31,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:46905 dest: /127.0.0.1:37740
2013-10-31 18:32:31,458 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:43015 dest: /127.0.0.1:59471
2013-10-31 18:32:31,459 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8597259860310358460_1102 src: /127.0.0.1:47190 dest: /127.0.0.1:54365
2013-10-31 18:32:31,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47190, dest: /127.0.0.1:54365, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8597259860310358460_1102, duration: 1501713
2013-10-31 18:32:31,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,462 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43015, dest: /127.0.0.1:59471, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 1712999
2013-10-31 18:32:31,462 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,462 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46905, dest: /127.0.0.1:37740, bytes: 176, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0009_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8597259860310358460_1102, duration: 2088924
2013-10-31 18:32:31,463 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8597259860310358460_1102 terminating
2013-10-31 18:32:31,463 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:31,464 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:31,465 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,465 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8597259860310358460_1102 size 176
2013-10-31 18:32:31,527 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,527 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 0.0%
2013-10-31 18:32:31,528 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,529 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0010_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,529 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 0.0%
2013-10-31 18:32:31,529 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 0.0%
2013-10-31 18:32:31,531 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0009_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:32:31,531 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0%
2013-10-31 18:32:31,858 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:31,860 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000002_0 is done.
2013-10-31 18:32:31,860 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000002_0 was -1
2013-10-31 18:32:31,860 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:32,212 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000003_0
2013-10-31 18:32:32,327 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000001_0
2013-10-31 18:32:32,327 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000002_0
2013-10-31 18:32:32,344 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:32,345 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000000_0
2013-10-31 18:32:32,387 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000002_0' has completed task_20131031182606197_0010_m_000002 successfully.
2013-10-31 18:32:32,390 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0010_m_000001_0
2013-10-31 18:32:32,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0 dst=null perm=null
2013-10-31 18:32:32,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000003_0 dst=null perm=null
2013-10-31 18:32:32,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0 dst=null perm=null
2013-10-31 18:32:32,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0 dst=null perm=null
2013-10-31 18:32:32,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0 dst=null perm=null
2013-10-31 18:32:32,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0 dst=null perm=null
2013-10-31 18:32:32,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:32,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:32,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000000_0 dst=null perm=null
2013-10-31 18:32:32,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000001_0 dst=null perm=null
2013-10-31 18:32:32,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000003_0 dst=null perm=null
2013-10-31 18:32:32,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary/_attempt_20131031182606197_0010_m_000001_0 dst=null perm=null
2013-10-31 18:32:33,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0 dst=null perm=null
2013-10-31 18:32:33,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:33,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:33,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary/_attempt_20131031182606197_0009_m_000002_0 dst=null perm=null
2013-10-31 18:32:33,835 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:33,837 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:33,838 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000000_0 is done.
2013-10-31 18:32:33,838 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000000_0 was -1
2013-10-31 18:32:33,838 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,216 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000000_0' has completed task_20131031182606197_0009_m_000000 successfully.
2013-10-31 18:32:35,241 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:35,243 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00001:0+214
2013-10-31 18:32:35,243 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000002_0 is done.
2013-10-31 18:32:35,243 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000002_0 was -1
2013-10-31 18:32:35,243 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,262 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:35,266 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00000:0+260
2013-10-31 18:32:35,267 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000000_0 is done.
2013-10-31 18:32:35,267 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000000_0 was -1
2013-10-31 18:32:35,268 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:32:35,289 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,291 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,292 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,292 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000001_0 is done.
2013-10-31 18:32:35,292 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000001_0 was -1
2013-10-31 18:32:35,292 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,295 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,296 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000003_0 is done.
2013-10-31 18:32:35,296 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000003_0 was -1
2013-10-31 18:32:35,297 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,306 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,308 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00003:0+260
2013-10-31 18:32:35,309 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000001_0 is done.
2013-10-31 18:32:35,309 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000001_0 was -1
2013-10-31 18:32:35,309 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,331 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000001_0' has completed task_20131031182606197_0009_m_000001 successfully.
2013-10-31 18:32:35,332 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000002_0' has completed task_20131031182606197_0009_m_000002 successfully.
2013-10-31 18:32:35,343 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,345 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34/part-00002:0+70
2013-10-31 18:32:35,346 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000003_0 is done.
2013-10-31 18:32:35,346 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000003_0 was -1
2013-10-31 18:32:35,346 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:35,348 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000000_0' has completed task_20131031182606197_0010_m_000000 successfully.
2013-10-31 18:32:35,351 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0009_m_000003_0
2013-10-31 18:32:35,394 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000001_0' has completed task_20131031182606197_0010_m_000001 successfully.
2013-10-31 18:32:38,223 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000003_0' has completed task_20131031182606197_0010_m_000003 successfully.
2013-10-31 18:32:38,227 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0010_m_000004_0' to tip task_20131031182606197_0010_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:38,231 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0010_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:38,231 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0010_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,232 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0010_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,266 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0010/attempt_20131031182606197_0010_m_000004_0. Attempting to reuse: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:38,353 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000003_0' has completed task_20131031182606197_0009_m_000003 successfully.
2013-10-31 18:32:38,357 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0009_m_000004_0' to tip task_20131031182606197_0009_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:38,359 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0009_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:32:38,360 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0009_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,360 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0009_m_000004_0 which needs 1 slots
2013-10-31 18:32:38,388 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0009/attempt_20131031182606197_0009_m_000004_0. Attempting to reuse: jvm_20131031182606197_0009_m_1345701271
2013-10-31 18:32:38,833 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0010_m_-775097629 given task: attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,881 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0009_m_1345701271 given task: attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:38,975 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000004_0 0.0%
2013-10-31 18:32:38,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary dst=null perm=null
2013-10-31 18:32:38,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:38,988 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS from client DFSClient_attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,989 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0010_m_000004_0
2013-10-31 18:32:38,992 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4134747532649829860 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036407782984700833 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6246259349516176919 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,993 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:38,994 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:38,994 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3808353552338567285 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:38,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0010 dst=null perm=null
2013-10-31 18:32:39,015 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000004_0 0.0%
2013-10-31 18:32:39,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary dst=null perm=null
2013-10-31 18:32:39,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:39,030 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS from client DFSClient_attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:39,030 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0009_m_000004_0
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1765133373633960270 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,036 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7445994968599272333 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4081485762383124586 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:39,037 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4993244343269496237 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:39,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0009 dst=null perm=null
2013-10-31 18:32:40,400 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:40,400 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:41,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data6/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:41,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data6/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:41,762 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data6/current/blk_-8036407782984700833
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data6/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data6/current/blk_-6246259349516176919
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data5/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data6/current/blk_-4134747532649829860
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data5/current/blk_-4081485762383124586
2013-10-31 18:32:41,763 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data5/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:41,764 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data5/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:41,764 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data5/current/blk_1765133373633960270
2013-10-31 18:32:41,764 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data5/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:41,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data5/current/blk_3808353552338567285
2013-10-31 18:32:41,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data5/current/blk_7445994968599272333
2013-10-31 18:32:41,919 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0010_m_000004_0 0.0% cleanup
2013-10-31 18:32:41,921 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0010_m_000004_0 is done.
2013-10-31 18:32:41,921 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0010_m_000004_0 was -1
2013-10-31 18:32:41,921 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:41,965 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0009_m_000004_0 0.0% cleanup
2013-10-31 18:32:41,966 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0009_m_000004_0 is done.
2013-10-31 18:32:41,967 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0009_m_000004_0 was -1
2013-10-31 18:32:41,967 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:42,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data7/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:42,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data7/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:42,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data7/current/blk_-8036407782984700833
2013-10-31 18:32:42,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data8/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:42,233 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data7/current/blk_-6246259349516176919
2013-10-31 18:32:42,233 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data7/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:42,233 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data8/current/blk_-4993244343269496237
2013-10-31 18:32:42,233 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data8/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:42,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data7/current/blk_-4134747532649829860
2013-10-31 18:32:42,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data8/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:42,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data8/current/blk_-4081485762383124586
2013-10-31 18:32:42,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data7/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:42,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data8/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:42,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data7/current/blk_3808353552338567285
2013-10-31 18:32:42,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data8/current/blk_1765133373633960270
2013-10-31 18:32:42,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data8/current/blk_7445994968599272333
2013-10-31 18:32:43,401 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-4134747532649829860_1082 blk_-6246259349516176919_1087 blk_-8036407782984700833_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_1765133373633960270_1082
2013-10-31 18:32:43,401 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4134747532649829860_1082 blk_-8036407782984700833_1085 blk_-4081485762383124586_1085 blk_7445994968599272333_1083 blk_-4993244343269496237_1088 blk_3808353552338567285_1088 blk_1765133373633960270_1082
2013-10-31 18:32:44,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data4/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:44,034 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data4/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:44,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data3/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:44,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4081485762383124586_1085 file build/test/data/dfs/data/data3/current/blk_-4081485762383124586 for deletion
2013-10-31 18:32:44,035 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data4/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:44,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3808353552338567285_1088 file build/test/data/dfs/data/data3/current/blk_3808353552338567285 for deletion
2013-10-31 18:32:44,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data3/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:44,237 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0010_m_000004_0' has completed task_20131031182606197_0010_m_000004 successfully.
2013-10-31 18:32:45,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036407782984700833_1085 file build/test/data/dfs/data/data1/current/blk_-8036407782984700833 for deletion
2013-10-31 18:32:45,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6246259349516176919_1087 file build/test/data/dfs/data/data2/current/blk_-6246259349516176919 for deletion
2013-10-31 18:32:45,160 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4993244343269496237_1088 file build/test/data/dfs/data/data1/current/blk_-4993244343269496237 for deletion
2013-10-31 18:32:45,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4134747532649829860_1082 file build/test/data/dfs/data/data1/current/blk_-4134747532649829860 for deletion
2013-10-31 18:32:45,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1765133373633960270_1082 file build/test/data/dfs/data/data2/current/blk_1765133373633960270 for deletion
2013-10-31 18:32:45,161 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7445994968599272333_1083 file build/test/data/dfs/data/data2/current/blk_7445994968599272333 for deletion
2013-10-31 18:32:45,645 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data4/current/blk_-8036407782984700833
2013-10-31 18:32:45,645 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6246259349516176919_1087 at file build/test/data/dfs/data/data2/current/blk_-6246259349516176919
2013-10-31 18:32:45,646 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data4/current/blk_-4993244343269496237
2013-10-31 18:32:45,646 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0010 has completed successfully.
2013-10-31 18:32:45,645 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036407782984700833_1085 at file build/test/data/dfs/data/data1/current/blk_-8036407782984700833
2013-10-31 18:32:45,646 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data2/current/blk_1765133373633960270
2013-10-31 18:32:45,647 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4993244343269496237_1088 at file build/test/data/dfs/data/data1/current/blk_-4993244343269496237
2013-10-31 18:32:45,647 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data2/current/blk_7445994968599272333
2013-10-31 18:32:45,646 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0010,submitTime=1383244333322,launchTime=1383244333702,firstMapTaskLaunchTime=1383244340329,firstJobSetupTaskLaunchTime=1383244334290,firstJobCleanupTaskLaunchTime=1383244358227,finishTime=1383244365646,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=56,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/8798AD252BB0435C9E93091132D74BF5] left+right/(3/3) ...pesplatform/nonsafesplit1
2013-10-31 18:32:45,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data3/current/blk_-4134747532649829860
2013-10-31 18:32:45,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4081485762383124586_1085 at file build/test/data/dfs/data/data3/current/blk_-4081485762383124586
2013-10-31 18:32:45,654 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C. blk_-1349162633554632614_1104
2013-10-31 18:32:45,654 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3808353552338567285_1088 at file build/test/data/dfs/data/data3/current/blk_3808353552338567285
2013-10-31 18:32:45,658 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7445994968599272333_1083 at file build/test/data/dfs/data/data3/current/blk_7445994968599272333
2013-10-31 18:32:45,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:47199 dest: /127.0.0.1:54365
2013-10-31 18:32:45,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:43026 dest: /127.0.0.1:59471
2013-10-31 18:32:45,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1349162633554632614_1104 src: /127.0.0.1:46918 dest: /127.0.0.1:37740
2013-10-31 18:32:45,664 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4134747532649829860_1082 at file build/test/data/dfs/data/data1/current/blk_-4134747532649829860
2013-10-31 18:32:45,673 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46918, dest: /127.0.0.1:37740, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1349162633554632614_1104, duration: 5952423
2013-10-31 18:32:45,673 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,674 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43026, dest: /127.0.0.1:59471, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1349162633554632614_1104, duration: 3990960
2013-10-31 18:32:45,674 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,675 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47199, dest: /127.0.0.1:54365, bytes: 21381, op: HDFS_WRITE, cliID: DFSClient_-1859484039, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1349162633554632614_1104, duration: 6948512
2013-10-31 18:32:45,675 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1349162633554632614_1104 terminating
2013-10-31 18:32:45,678 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,679 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,679 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1349162633554632614_1104 size 21381
2013-10-31 18:32:45,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1765133373633960270_1082 at file build/test/data/dfs/data/data4/current/blk_1765133373633960270
2013-10-31 18:32:46,079 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C from client DFSClient_-1859484039
2013-10-31 18:32:46,079 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_logs/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C is closed by DFSClient_-1859484039
2013-10-31 18:32:46,085 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0010_1383244333322_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2F8798AD252BB0435C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,086 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000003_0'
2013-10-31 18:32:46,086 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000004_0'
2013-10-31 18:32:46,088 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000001_0'
2013-10-31 18:32:46,088 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,088 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000002_0'
2013-10-31 18:32:46,089 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,089 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0009_m_000004_0' has completed task_20131031182606197_0009_m_000004 successfully.
2013-10-31 18:32:46,089 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_726165482891072064 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,090 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0009 has completed successfully.
2013-10-31 18:32:46,091 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0009,submitTime=1383244333260,launchTime=1383244333624,firstMapTaskLaunchTime=1383244340192,firstJobSetupTaskLaunchTime=1383244334176,firstJobCleanupTaskLaunchTime=1383244358357,finishTime=1383244366090,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=66,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[3CB815650E6B4FC3B298C6C9B575DB86/AA9F83F00E7342EFB347F9FE5B8337F4] left+right/(2/3) ...pesplatform/nonsafesplit2
2013-10-31 18:32:46,092 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0010_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0010 dst=null perm=null
2013-10-31 18:32:46,097 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF. blk_-7021182400753421927_1104
2013-10-31 18:32:46,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:43029 dest: /127.0.0.1:59471
2013-10-31 18:32:46,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:46921 dest: /127.0.0.1:37740
2013-10-31 18:32:46,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7021182400753421927_1104 src: /127.0.0.1:49835 dest: /127.0.0.1:34578
2013-10-31 18:32:46,104 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49835, dest: /127.0.0.1:34578, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7021182400753421927_1104, duration: 89813
2013-10-31 18:32:46,105 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,105 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,105 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46921, dest: /127.0.0.1:37740, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7021182400753421927_1104, duration: 863378
2013-10-31 18:32:46,106 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,106 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,106 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43029, dest: /127.0.0.1:59471, bytes: 21705, op: HDFS_WRITE, cliID: DFSClient_-636476314, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7021182400753421927_1104, duration: 1976435
2013-10-31 18:32:46,107 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7021182400753421927_1104 terminating
2013-10-31 18:32:46,110 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF from client DFSClient_-636476314
2013-10-31 18:32:46,110 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_logs/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF is closed by DFSClient_-636476314
2013-10-31 18:32:46,111 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7021182400753421927_1104 size 21705
2013-10-31 18:32:46,117 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000003_0'
2013-10-31 18:32:46,117 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,117 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000004_0'
2013-10-31 18:32:46,117 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,118 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000000_0'
2013-10-31 18:32:46,118 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6152330823190221756 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000001_0'
2013-10-31 18:32:46,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000002_0'
2013-10-31 18:32:46,119 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0010_m_000005_0'
2013-10-31 18:32:46,120 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0009_1383244333260_hadoop_%5B3CB815650E6B4FC3B298C6C9B575DB86%2FAA9F83F00E7342EF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0009 dst=null perm=null
2013-10-31 18:32:46,125 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0009_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:32:46,166 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,166 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,166 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8232283085439151097 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,166 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,167 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,167 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2396101614590861125 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,167 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,167 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,168 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7738361136727118235 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,168 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,168 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:32:46,168 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-257311796089327943 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,168 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,169 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,169 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7731653809023951984 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,169 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:32:46,169 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:32:46,170 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4349690085078030343 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:32:46,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6268837627_split_EF235C676AD4427F920D4F671B138A34 dst=null perm=null
2013-10-31 18:32:46,176 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/_temporary
2013-10-31 18:32:46,177 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/_temporary
2013-10-31 18:32:46,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=null
2013-10-31 18:32:46,199 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:46,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000 dst=null perm=null
2013-10-31 18:32:46,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001 dst=null perm=null
2013-10-31 18:32:46,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002 dst=null perm=null
2013-10-31 18:32:46,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003 dst=null perm=null
2013-10-31 18:32:46,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000 dst=null perm=null
2013-10-31 18:32:46,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001 dst=null perm=null
2013-10-31 18:32:46,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002 dst=null perm=null
2013-10-31 18:32:46,207 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49836, bytes: 134, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3055933182081159268_1096, duration: 303541
2013-10-31 18:32:46,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003 dst=null perm=null
2013-10-31 18:32:46,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=null
2013-10-31 18:32:46,217 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:32:46,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000 dst=null perm=null
2013-10-31 18:32:46,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001 dst=null perm=null
2013-10-31 18:32:46,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002 dst=null perm=null
2013-10-31 18:32:46,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003 dst=null perm=null
2013-10-31 18:32:46,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000 dst=null perm=null
2013-10-31 18:32:46,224 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46925, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5467518339498007322_1095, duration: 180470
2013-10-31 18:32:46,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001 dst=null perm=null
2013-10-31 18:32:46,226 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43035, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 148924
2013-10-31 18:32:46,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002 dst=null perm=null
2013-10-31 18:32:46,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003 dst=null perm=null
2013-10-31 18:32:46,228 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nonsafesplit2
2013-10-31 18:32:46,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2 dst=null perm=null
2013-10-31 18:32:46,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00000 dst=null perm=null
2013-10-31 18:32:46,235 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43036, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5467518339498007322_1095, duration: 211121
2013-10-31 18:32:46,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00001 dst=null perm=null
2013-10-31 18:32:46,238 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43037, bytes: 180, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8597259860310358460_1102, duration: 156390
2013-10-31 18:32:46,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00002 dst=null perm=null
2013-10-31 18:32:46,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit2/part-00003 dst=null perm=null
2013-10-31 18:32:46,243 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nonsafesplit1
2013-10-31 18:32:46,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1 dst=null perm=null
2013-10-31 18:32:46,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00000 dst=null perm=null
2013-10-31 18:32:46,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00001 dst=null perm=null
2013-10-31 18:32:46,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00002 dst=null perm=null
2013-10-31 18:32:46,257 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43038, bytes: 134, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3055933182081159268_1096, duration: 276335
2013-10-31 18:32:46,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nonsafesplit1/part-00003 dst=null perm=null
2013-10-31 18:32:46,279 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:32:46,279 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:32:46,299 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] starting
2013-10-31 18:32:46,300 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] source: Hfs["TextLine[['num', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:32:46,300 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2"]
2013-10-31 18:32:46,301 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1"]
2013-10-31 18:32:46,301 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] parallel execution is enabled: true
2013-10-31 18:32:46,301 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] starting jobs: 3
2013-10-31 18:32:46,301 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [output1+output2] allocating threads: 3
2013-10-31 18:32:46,303 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (1/3)
2013-10-31 18:32:46,307 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:32:46,307 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:32:46,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:46,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:32:46,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,327 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar. blk_-1646609186769667995_1105
2013-10-31 18:32:46,329 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:43039 dest: /127.0.0.1:59471
2013-10-31 18:32:46,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:49843 dest: /127.0.0.1:34578
2013-10-31 18:32:46,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:46932 dest: /127.0.0.1:37740
2013-10-31 18:32:46,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46932, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1646609186769667995_1105, duration: 4743523
2013-10-31 18:32:46,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49843, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 3922146
2013-10-31 18:32:46,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43039, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1646609186769667995_1105, duration: 4806708
2013-10-31 18:32:46,338 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,338 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1646609186769667995_1105 terminating
2013-10-31 18:32:46,339 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar from client DFSClient_-1596270109
2013-10-31 18:32:46,340 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:32:46,340 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,342 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:46,344 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar. New replication is 10
2013-10-31 18:32:46,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=null
2013-10-31 18:32:46,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,357 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:32:46,362 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:32:46,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:32:46,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:46,375 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split. New replication is 10
2013-10-31 18:32:46,402 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-1646609186769667995_1105 to datanode(s) 127.0.0.1:54365
2013-10-31 18:32:46,402 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_4349690085078030343_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_-8232283085439151097_1080 blk_7738361136727118235_1077 blk_-6152330823190221756_1091
2013-10-31 18:32:46,403 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_4349690085078030343_1079 blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_-8232283085439151097_1080 blk_7738361136727118235_1077
2013-10-31 18:32:47,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=null
2013-10-31 18:32:47,243 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split. blk_4636075907529433197_1106
2013-10-31 18:32:47,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:47216 dest: /127.0.0.1:54365
2013-10-31 18:32:47,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:43043 dest: /127.0.0.1:59471
2013-10-31 18:32:47,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:49847 dest: /127.0.0.1:34578
2013-10-31 18:32:47,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4636075907529433197_1106 src: /127.0.0.1:46936 dest: /127.0.0.1:37740
2013-10-31 18:32:47,253 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46936, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4636075907529433197_1106, duration: 113985
2013-10-31 18:32:47,254 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,254 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49847, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4636075907529433197_1106, duration: 955590
2013-10-31 18:32:47,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,255 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43043, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 1950244
2013-10-31 18:32:47,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,256 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47216, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 2790715
2013-10-31 18:32:47,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4636075907529433197_1106 terminating
2013-10-31 18:32:47,258 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,260 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split from client DFSClient_-1596270109
2013-10-31 18:32:47,261 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split is closed by DFSClient_-1596270109
2013-10-31 18:32:47,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4636075907529433197_1106 size 1403
2013-10-31 18:32:47,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,276 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo. blk_1473407138158581377_1107
2013-10-31 18:32:47,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:49849 dest: /127.0.0.1:34578
2013-10-31 18:32:47,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:47221 dest: /127.0.0.1:54365
2013-10-31 18:32:47,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1473407138158581377_1107 src: /127.0.0.1:43048 dest: /127.0.0.1:59471
2013-10-31 18:32:47,284 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43048, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1473407138158581377_1107, duration: 69079
2013-10-31 18:32:47,284 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,284 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47221, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1473407138158581377_1107, duration: 868210
2013-10-31 18:32:47,285 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,285 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49849, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1473407138158581377_1107, duration: 1740711
2013-10-31 18:32:47,286 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1473407138158581377_1107 terminating
2013-10-31 18:32:47,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,288 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1473407138158581377_1107 size 156
2013-10-31 18:32:47,289 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:32:47,289 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:32:47,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,312 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml. blk_-5658866385858982902_1108
2013-10-31 18:32:47,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:47223 dest: /127.0.0.1:54365
2013-10-31 18:32:47,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:49853 dest: /127.0.0.1:34578
2013-10-31 18:32:47,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5658866385858982902_1108 src: /127.0.0.1:43051 dest: /127.0.0.1:59471
2013-10-31 18:32:47,320 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43051, dest: /127.0.0.1:59471, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 194618
2013-10-31 18:32:47,320 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,321 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49853, dest: /127.0.0.1:34578, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5658866385858982902_1108, duration: 961673
2013-10-31 18:32:47,321 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,321 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,321 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47223, dest: /127.0.0.1:54365, bytes: 27679, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 1822365
2013-10-31 18:32:47,322 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,322 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5658866385858982902_1108 terminating
2013-10-31 18:32:47,326 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml from client DFSClient_-1596270109
2013-10-31 18:32:47,326 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:32:47,327 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5658866385858982902_1108 size 27679
2013-10-31 18:32:47,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=null
2013-10-31 18:32:47,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43053, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-368931034, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 396741
2013-10-31 18:32:47,359 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0011: nMaps=4 nReduces=1 max=-1
2013-10-31 18:32:47,360 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0011 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:32:47,360 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0011 RESULT=SUCCESS
2013-10-31 18:32:47,360 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0011
2013-10-31 18:32:47,360 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0011
2013-10-31 18:32:47,360 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0011
2013-10-31 18:32:47,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,380 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml. blk_-3041080366967563833_1110
2013-10-31 18:32:47,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:47228 dest: /127.0.0.1:54365
2013-10-31 18:32:47,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:43055 dest: /127.0.0.1:59471
2013-10-31 18:32:47,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3041080366967563833_1110 src: /127.0.0.1:49859 dest: /127.0.0.1:34578
2013-10-31 18:32:47,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49859, dest: /127.0.0.1:34578, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3041080366967563833_1110, duration: 658932
2013-10-31 18:32:47,385 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43055, dest: /127.0.0.1:59471, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3041080366967563833_1110, duration: 1481855
2013-10-31 18:32:47,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,386 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47228, dest: /127.0.0.1:54365, bytes: 27744, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3041080366967563833_1110, duration: 1866504
2013-10-31 18:32:47,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3041080366967563833_1110 terminating
2013-10-31 18:32:47,389 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,389 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml from client DFSClient_-368931034
2013-10-31 18:32:47,389 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_conf.xml is closed by DFSClient_-368931034
2013-10-31 18:32:47,390 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,390 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3041080366967563833_1110 size 27744
2013-10-31 18:32:47,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:32:47,400 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken. blk_7656384865086930476_1111
2013-10-31 18:32:47,402 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:49860 dest: /127.0.0.1:34578
2013-10-31 18:32:47,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:46949 dest: /127.0.0.1:37740
2013-10-31 18:32:47,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7656384865086930476_1111 src: /127.0.0.1:43059 dest: /127.0.0.1:59471
2013-10-31 18:32:47,408 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43059, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7656384865086930476_1111, duration: 69500
2013-10-31 18:32:47,408 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,408 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:46949, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7656384865086930476_1111, duration: 858730
2013-10-31 18:32:47,409 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,409 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49860, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 1822027
2013-10-31 18:32:47,410 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7656384865086930476_1111 terminating
2013-10-31 18:32:47,412 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7656384865086930476_1111 size 116
2013-10-31 18:32:47,413 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken from client DFSClient_-1596270109
2013-10-31 18:32:47,413 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:32:47,418 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken
2013-10-31 18:32:47,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.splitmetainfo dst=null perm=null
2013-10-31 18:32:47,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47234, bytes: 160, op: HDFS_READ, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1473407138158581377_1107, duration: 269435
2013-10-31 18:32:47,423 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0011 = 1449. Number of splits = 4
2013-10-31 18:32:47,423 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,424 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,425 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0011_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:32:47,426 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0011 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:32:47,427 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0011 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:32:47,764 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-1646609186769667995_1105 to 127.0.0.1:54365
2013-10-31 18:32:47,764 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data5/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:47,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data6/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:47,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data5/current/blk_-8232283085439151097
2013-10-31 18:32:47,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data6/current/blk_-6152330823190221756
2013-10-31 18:32:47,765 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data6/current/blk_726165482891072064 for deletion
2013-10-31 18:32:47,766 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data6/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:47,766 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1646609186769667995_1105 src: /127.0.0.1:47235 dest: /127.0.0.1:54365
2013-10-31 18:32:47,766 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data5/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:47,766 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data6/current/blk_726165482891072064
2013-10-31 18:32:47,767 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data5/current/blk_7731653809023951984
2013-10-31 18:32:47,767 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data6/current/blk_4349690085078030343
2013-10-31 18:32:47,767 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data6/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:47,767 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-1646609186769667995_1105 to /127.0.0.1:54365
2013-10-31 18:32:47,768 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data6/current/blk_7738361136727118235
2013-10-31 18:32:47,769 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1646609186769667995_1105 src: /127.0.0.1:47235 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:32:47,774 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1646609186769667995_1105 size 238055
2013-10-31 18:32:48,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data7/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:48,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data7/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:48,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data7/current/blk_-8232283085439151097
2013-10-31 18:32:48,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data8/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:48,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data7/current/blk_-2396101614590861125
2013-10-31 18:32:48,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data7/current/blk_726165482891072064 for deletion
2013-10-31 18:32:48,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data8/current/blk_-257311796089327943
2013-10-31 18:32:48,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data7/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:48,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data7/current/blk_726165482891072064
2013-10-31 18:32:48,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data7/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:48,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data7/current/blk_4349690085078030343
2013-10-31 18:32:48,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data8/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:48,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data7/current/blk_7731653809023951984
2013-10-31 18:32:48,237 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data8/current/blk_7738361136727118235
2013-10-31 18:32:49,092 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0011_m_000005_0' to tip task_20131031182606197_0011_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:49,097 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000000_0'
2013-10-31 18:32:49,097 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0009_m_000005_0'
2013-10-31 18:32:49,100 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:32:49,100 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000005_0 which needs 1 slots
2013-10-31 18:32:49,100 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000005_0 which needs 1 slots
2013-10-31 18:32:49,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken dst=null perm=null
2013-10-31 18:32:49,109 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49865, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 317494
2013-10-31 18:32:49,109 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 66 raw values into 2 aggregated values, total 6
2013-10-31 18:32:49,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=null
2013-10-31 18:32:49,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47238, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-324736910, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 399692
2013-10-31 18:32:49,149 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:49,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=null
2013-10-31 18:32:49,184 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49868, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-324736910, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 1796035
2013-10-31 18:32:49,279 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:49,286 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22279 with signal TERM. Exit code 0
2013-10-31 18:32:49,286 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:32:49,289 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_-575970400 spawned.
2013-10-31 18:32:49,290 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000005_0/taskjvm.sh
2013-10-31 18:32:49,403 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_4349690085078030343_1079 blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_726165482891072064_1094 blk_7731653809023951984_1077 blk_7738361136727118235_1077 blk_-6152330823190221756_1091
2013-10-31 18:32:49,404 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-2396101614590861125_1074 blk_-257311796089327943_1079 blk_-8232283085439151097_1080 blk_-6152330823190221756_1091
2013-10-31 18:32:49,959 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0010_m_-775097629
2013-10-31 18:32:50,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8232283085439151097_1080 file build/test/data/dfs/data/data3/current/blk_-8232283085439151097 for deletion
2013-10-31 18:32:50,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data3/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:50,036 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8232283085439151097_1080 at file build/test/data/dfs/data/data3/current/blk_-8232283085439151097
2013-10-31 18:32:50,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data4/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:50,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data3/current/blk_-6152330823190221756
2013-10-31 18:32:50,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data4/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:50,037 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data4/current/blk_-2396101614590861125
2013-10-31 18:32:50,038 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data4/current/blk_-257311796089327943
2013-10-31 18:32:50,667 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:50,668 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:50,668 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:50,668 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_-775097629 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:32:51,088 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:51,088 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000003_0 not found in cache
2013-10-31 18:32:51,089 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000004_0 not found in cache
2013-10-31 18:32:51,089 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330771089
2013-10-31 18:32:51,089 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:51,090 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000002_0 not found in cache
2013-10-31 18:32:51,090 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000001_0 not found in cache
2013-10-31 18:32:51,090 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330771090
2013-10-31 18:32:51,090 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,090 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0009 being deleted.
2013-10-31 18:32:51,119 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,119 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000004_0 not found in cache
2013-10-31 18:32:51,119 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000003_0 not found in cache
2013-10-31 18:32:51,120 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330771119
2013-10-31 18:32:51,120 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:51,120 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000001_0 not found in cache
2013-10-31 18:32:51,120 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000002_0 not found in cache
2013-10-31 18:32:51,121 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330771121
2013-10-31 18:32:51,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6152330823190221756_1091 file build/test/data/dfs/data/data1/current/blk_-6152330823190221756 for deletion
2013-10-31 18:32:51,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6152330823190221756_1091 at file build/test/data/dfs/data/data1/current/blk_-6152330823190221756
2013-10-31 18:32:51,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2396101614590861125_1074 file build/test/data/dfs/data/data2/current/blk_-2396101614590861125 for deletion
2013-10-31 18:32:51,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2396101614590861125_1074 at file build/test/data/dfs/data/data2/current/blk_-2396101614590861125
2013-10-31 18:32:51,162 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-257311796089327943_1079 file build/test/data/dfs/data/data1/current/blk_-257311796089327943 for deletion
2013-10-31 18:32:51,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-257311796089327943_1079 at file build/test/data/dfs/data/data1/current/blk_-257311796089327943
2013-10-31 18:32:51,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_726165482891072064_1094 file build/test/data/dfs/data/data1/current/blk_726165482891072064 for deletion
2013-10-31 18:32:51,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_726165482891072064_1094 at file build/test/data/dfs/data/data1/current/blk_726165482891072064
2013-10-31 18:32:51,163 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4349690085078030343_1079 file build/test/data/dfs/data/data2/current/blk_4349690085078030343 for deletion
2013-10-31 18:32:51,164 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4349690085078030343_1079 at file build/test/data/dfs/data/data2/current/blk_4349690085078030343
2013-10-31 18:32:51,164 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7731653809023951984_1077 file build/test/data/dfs/data/data1/current/blk_7731653809023951984 for deletion
2013-10-31 18:32:51,164 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7731653809023951984_1077 at file build/test/data/dfs/data/data1/current/blk_7731653809023951984
2013-10-31 18:32:51,164 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7738361136727118235_1077 file build/test/data/dfs/data/data2/current/blk_7738361136727118235 for deletion
2013-10-31 18:32:51,164 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7738361136727118235_1077 at file build/test/data/dfs/data/data2/current/blk_7738361136727118235
2013-10-31 18:32:51,353 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-575970400 given task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:32:51,506 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_1345701271 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:51,511 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22284 with signal TERM. Exit code 0
2013-10-31 18:32:51,650 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:51,650 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:51,651 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:51,651 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_1345701271 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:32:51,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:32:51,932 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_1371704024 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:51,941 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22242 with signal TERM. Exit code 0
2013-10-31 18:32:52,134 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,134 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,134 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:52,134 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_1371704024 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,278 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_-760035825 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:52,288 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22283 with signal TERM. Exit code 0
2013-10-31 18:32:52,334 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_1071625860 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:52,342 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22282 with signal TERM. Exit code 0
2013-10-31 18:32:52,357 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_-1154774997 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:52,362 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22280 with signal TERM. Exit code 0
2013-10-31 18:32:52,508 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,509 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,509 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:52,509 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_-760035825 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,529 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,529 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,529 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:52,529 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_1071625860 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:52,537 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:52,537 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:52,537 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:52,537 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_-1154774997 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:54,776 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000005_0 0.0% setup
2013-10-31 18:32:54,780 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000005_0 is done.
2013-10-31 18:32:54,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000005_0 was -1
2013-10-31 18:32:54,781 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:32:55,105 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000005_0' has completed task_20131031182606197_0011_m_000005 successfully.
2013-10-31 18:32:55,108 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000000_0' to tip task_20131031182606197_0011_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:32:55,109 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000000
2013-10-31 18:32:55,111 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:32:55,111 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000000_0 which needs 1 slots
2013-10-31 18:32:55,112 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000000_0 which needs 1 slots
2013-10-31 18:32:55,128 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000001_0' to tip task_20131031182606197_0011_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:32:55,128 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000001
2013-10-31 18:32:55,130 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:32:55,130 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000002_0' to tip task_20131031182606197_0011_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:32:55,130 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000001_0 which needs 1 slots
2013-10-31 18:32:55,131 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000001_0 which needs 1 slots
2013-10-31 18:32:55,131 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000002
2013-10-31 18:32:55,133 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:32:55,133 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000002_0 which needs 1 slots
2013-10-31 18:32:55,133 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000002_0 which needs 1 slots
2013-10-31 18:32:55,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken dst=null perm=null
2013-10-31 18:32:55,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken dst=null perm=null
2013-10-31 18:32:55,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49872, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 144122
2013-10-31 18:32:55,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43070, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7656384865086930476_1111, duration: 911446
2013-10-31 18:32:55,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=null
2013-10-31 18:32:55,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=null
2013-10-31 18:32:55,169 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43073, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-764662643, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5658866385858982902_1108, duration: 168873
2013-10-31 18:32:55,171 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49877, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-1527887059, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5658866385858982902_1108, duration: 411774
2013-10-31 18:32:55,176 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0011/attempt_20131031182606197_0011_m_000000_0. Attempting to reuse: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:32:55,185 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:55,189 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:55,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=null
2013-10-31 18:32:55,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43075, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1527887059, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1646609186769667995_1105, duration: 606197
2013-10-31 18:32:55,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=null
2013-10-31 18:32:55,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-764662643, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1646609186769667995_1105, duration: 629820
2013-10-31 18:32:55,258 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_-538677001
2013-10-31 18:32:55,259 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_-538677001 spawned.
2013-10-31 18:32:55,260 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000002_0/taskjvm.sh
2013-10-31 18:32:55,269 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_1012864139
2013-10-31 18:32:55,269 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_1012864139 spawned.
2013-10-31 18:32:55,270 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000001_0/taskjvm.sh
2013-10-31 18:32:55,466 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-575970400 given task: attempt_20131031182606197_0011_m_000000_0
2013-10-31 18:32:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:32:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:32:56,047 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 18:32:56,089 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0009
2013-10-31 18:32:56,089 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0009_m_000000_0 not found in cache
2013-10-31 18:32:56,090 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0009 for user-log deletion with retainTimeStamp:1383330776090
2013-10-31 18:32:56,120 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:56,120 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0010_m_000000_0 not found in cache
2013-10-31 18:32:56,121 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330776121
2013-10-31 18:32:56,121 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0010
2013-10-31 18:32:56,122 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0010 for user-log deletion with retainTimeStamp:1383330776121
2013-10-31 18:32:56,823 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0010_m_-1788039440 since job job_20131031182606197_0010 is dead
2013-10-31 18:32:56,833 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22281 with signal TERM. Exit code 0
2013-10-31 18:32:56,899 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0009_m_759702916 since job job_20131031182606197_0009 is dead
2013-10-31 18:32:56,905 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22053 with signal TERM. Exit code 0
2013-10-31 18:32:57,047 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:57,047 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:57,047 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:57,047 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0010_m_-1788039440 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:57,079 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:32:57,079 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:32:57,079 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:32:57,079 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0009_m_759702916 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:32:57,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=null
2013-10-31 18:32:57,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43078, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 371267
2013-10-31 18:32:57,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:32:57,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47253, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 263772
2013-10-31 18:32:58,107 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0011_m_000003_0' to tip task_20131031182606197_0011_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:32:58,108 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0011_m_000003
2013-10-31 18:32:58,109 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:32:58,109 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000003_0 which needs 1 slots
2013-10-31 18:32:58,109 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000003_0 which needs 1 slots
2013-10-31 18:32:58,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011/jobToken dst=null perm=null
2013-10-31 18:32:58,114 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49883, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7656384865086930476_1111, duration: 153124
2013-10-31 18:32:58,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.xml dst=null perm=null
2013-10-31 18:32:58,118 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47256, bytes: 27899, op: HDFS_READ, cliID: DFSClient_-197170435, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5658866385858982902_1108, duration: 182385
2013-10-31 18:32:58,131 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:32:58,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.jar dst=null perm=null
2013-10-31 18:32:58,145 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49886, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-197170435, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1646609186769667995_1105, duration: 610040
2013-10-31 18:32:58,202 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_116991220
2013-10-31 18:32:58,203 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_116991220 spawned.
2013-10-31 18:32:58,205 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000003_0/taskjvm.sh
2013-10-31 18:32:58,432 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_-538677001 given task: attempt_20131031182606197_0011_m_000002_0
2013-10-31 18:32:58,484 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_1012864139 given task: attempt_20131031182606197_0011_m_000001_0
2013-10-31 18:32:58,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=null
2013-10-31 18:32:58,946 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47262, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 173941
2013-10-31 18:32:58,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=null
2013-10-31 18:32:58,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:32:58,985 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49893, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 164032
2013-10-31 18:32:58,985 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47263, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4636075907529433197_1106, duration: 190872
2013-10-31 18:32:59,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:32:59,244 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:46982, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 180332
2013-10-31 18:33:00,457 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:33:00,461 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000000_0 is done.
2013-10-31 18:33:00,461 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000000_0 was 353
2013-10-31 18:33:00,461 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:01,090 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:33:01,091 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0011_m_000005_0
2013-10-31 18:33:01,091 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0011_m_000005_0 not found in cache
2013-10-31 18:33:01,116 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000000_0' has completed task_20131031182606197_0011_m_000000 successfully.
2013-10-31 18:33:01,117 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0011_r_000000_0' to tip task_20131031182606197_0011_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:01,119 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:01,119 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_r_000000_0 which needs 1 slots
2013-10-31 18:33:01,119 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_r_000000_0 which needs 1 slots
2013-10-31 18:33:01,159 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_r_1328977401
2013-10-31 18:33:01,160 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_r_1328977401 spawned.
2013-10-31 18:33:01,161 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_r_000000_0/taskjvm.sh
2013-10-31 18:33:01,811 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_116991220 given task: attempt_20131031182606197_0011_m_000003_0
2013-10-31 18:33:01,873 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:33:01,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000002_0 is done.
2013-10-31 18:33:01,874 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000002_0 was 481
2013-10-31 18:33:01,874 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:01,908 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:33:01,909 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000001_0 is done.
2013-10-31 18:33:01,909 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000001_0 was 436
2013-10-31 18:33:01,909 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:02,122 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_r_1328977401 given task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:02,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011/job.split dst=null perm=null
2013-10-31 18:33:02,318 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43095, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4636075907529433197_1106, duration: 138566
2013-10-31 18:33:02,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:33:02,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49899, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0011_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 152969
2013-10-31 18:33:04,137 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000001_0' has completed task_20131031182606197_0011_m_000001 successfully.
2013-10-31 18:33:04,140 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000002_0' has completed task_20131031182606197_0011_m_000002 successfully.
2013-10-31 18:33:05,242 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:33:05,245 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000003_0 is done.
2013-10-31 18:33:05,245 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000003_0 was 341
2013-10-31 18:33:05,245 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:07,119 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000003_0' has completed task_20131031182606197_0011_m_000003 successfully.
2013-10-31 18:33:07,813 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:48937, bytes: 353, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000000_0, duration: 8509094
2013-10-31 18:33:07,839 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41304, bytes: 436, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000001_0, duration: 13335365
2013-10-31 18:33:07,858 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39284, bytes: 481, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000002_0, duration: 13278874
2013-10-31 18:33:08,626 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
2013-10-31 18:33:10,128 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 3 OK for attempt_20131031182606197_0011_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:11,677 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
2013-10-31 18:33:12,883 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:43982, bytes: 341, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0011_m_000003_0, duration: 14726197
2013-10-31 18:33:13,690 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
2013-10-31 18:33:13,751 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
2013-10-31 18:33:13,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:13,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:13,967 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000. blk_1328316139791502870_1112
2013-10-31 18:33:14,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:43104 dest: /127.0.0.1:59471
2013-10-31 18:33:14,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:49908 dest: /127.0.0.1:34578
2013-10-31 18:33:14,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1328316139791502870_1112 src: /127.0.0.1:47280 dest: /127.0.0.1:54365
2013-10-31 18:33:14,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47280, dest: /127.0.0.1:54365, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1328316139791502870_1112, duration: 1387858
2013-10-31 18:33:14,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49908, dest: /127.0.0.1:34578, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1328316139791502870_1112, duration: 1484862
2013-10-31 18:33:14,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43104, dest: /127.0.0.1:59471, bytes: 1697, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0011_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1328316139791502870_1112, duration: 2282553
2013-10-31 18:33:14,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1328316139791502870_1112 terminating
2013-10-31 18:33:14,014 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1328316139791502870_1112 size 1697
2013-10-31 18:33:14,018 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:14,019 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:14,055 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0011_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:14,056 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 0.25% reduce > copy (3 of 4 at 0.00 MB/s) >
2013-10-31 18:33:16,136 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0011_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:16,137 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:17,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0 dst=null perm=null
2013-10-31 18:33:17,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:17,722 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:18,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:19,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary/_attempt_20131031182606197_0011_r_000000_0 dst=null perm=null
2013-10-31 18:33:20,761 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:20,762 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:20,763 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_r_000000_0 is done.
2013-10-31 18:33:20,763 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_r_000000_0 was -1
2013-10-31 18:33:20,763 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:22,145 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_r_000000_0' has completed task_20131031182606197_0011_r_000000 successfully.
2013-10-31 18:33:22,150 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0011_m_000004_0' to tip task_20131031182606197_0011_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:22,153 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0011_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:33:22,153 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0011_m_000004_0 which needs 1 slots
2013-10-31 18:33:22,153 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0011_m_000004_0 which needs 1 slots
2013-10-31 18:33:22,186 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0011_m_1263282871
2013-10-31 18:33:22,187 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0011_m_1263282871 spawned.
2013-10-31 18:33:22,190 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0011/attempt_20131031182606197_0011_m_000004_0/taskjvm.sh
2013-10-31 18:33:23,488 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0011_m_1263282871 given task: attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,025 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000004_0 0.0%
2013-10-31 18:33:24,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_temporary dst=null perm=null
2013-10-31 18:33:24,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:24,047 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS from client DFSClient_attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,047 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0011_m_000004_0
2013-10-31 18:33:24,053 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,053 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:24,053 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1646609186769667995 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:24,054 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4636075907529433197 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,055 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,055 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,055 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1473407138158581377 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,055 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:24,056 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:24,056 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5658866385858982902 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:24,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0011 dst=null perm=null
2013-10-31 18:33:25,409 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:25,410 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_4636075907529433197_1106 blk_-1646609186769667995_1105
2013-10-31 18:33:26,777 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data6/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:26,777 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data5/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:26,777 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data6/current/blk_-5658866385858982902
2013-10-31 18:33:26,777 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data5/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:26,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data5/current/blk_-1646609186769667995
2013-10-31 18:33:26,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data6/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:26,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data5/current/blk_1473407138158581377
2013-10-31 18:33:26,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data6/current/blk_4636075907529433197
2013-10-31 18:33:26,937 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0011_m_000004_0 0.0% cleanup
2013-10-31 18:33:26,938 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0011_m_000004_0 is done.
2013-10-31 18:33:26,938 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0011_m_000004_0 was -1
2013-10-31 18:33:26,939 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:27,153 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:27,154 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0011_r_000000_0
2013-10-31 18:33:27,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data8/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:27,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data7/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:27,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data8/current/blk_-1646609186769667995
2013-10-31 18:33:27,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data7/current/blk_4636075907529433197
2013-10-31 18:33:28,160 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0011_m_000004_0' has completed task_20131031182606197_0011_m_000004 successfully.
2013-10-31 18:33:28,179 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0011 has completed successfully.
2013-10-31 18:33:28,179 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0011,submitTime=1383244367332,launchTime=1383244367427,firstMapTaskLaunchTime=1383244375108,firstReduceTaskLaunchTime=1383244381117,firstJobSetupTaskLaunchTime=1383244369092,firstJobCleanupTaskLaunchTime=1383244402150,finishTime=1383244408179,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=36,reduceSlotsSeconds=19,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/F143AB928B67435F8F0ECD5AF509F2A0] output1+output2/(1/3)
2013-10-31 18:33:28,192 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F. blk_548298036330803898_1113
2013-10-31 18:33:28,195 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:47002 dest: /127.0.0.1:37740
2013-10-31 18:33:28,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:49915 dest: /127.0.0.1:34578
2013-10-31 18:33:28,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_548298036330803898_1113 src: /127.0.0.1:47287 dest: /127.0.0.1:54365
2013-10-31 18:33:28,210 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47287, dest: /127.0.0.1:54365, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_548298036330803898_1113, duration: 7517806
2013-10-31 18:33:28,210 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,210 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49915, dest: /127.0.0.1:34578, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_548298036330803898_1113, duration: 6348055
2013-10-31 18:33:28,211 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,212 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47002, dest: /127.0.0.1:37740, bytes: 28334, op: HDFS_WRITE, cliID: DFSClient_-368931034, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_548298036330803898_1113, duration: 5319257
2013-10-31 18:33:28,212 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_548298036330803898_1113 terminating
2013-10-31 18:33:28,212 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,216 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_548298036330803898_1113 size 28334
2013-10-31 18:33:28,216 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F from client DFSClient_-368931034
2013-10-31 18:33:28,217 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/_logs/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F is closed by DFSClient_-368931034
2013-10-31 18:33:28,217 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 597 Total time for transactions(ms): 15Number of transactions batched in Syncs: 48 Number of syncs: 407 SyncTimes(ms): 52993 12200
2013-10-31 18:33:28,224 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0011_1383244367332_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FF143AB928B67435F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:28,224 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000000_0'
2013-10-31 18:33:28,224 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000004_0'
2013-10-31 18:33:28,225 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000005_0'
2013-10-31 18:33:28,225 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_r_000000_0'
2013-10-31 18:33:28,226 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:28,226 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:28,227 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000002_0'
2013-10-31 18:33:28,227 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7656384865086930476 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:28,227 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000001_0'
2013-10-31 18:33:28,230 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0011_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:28,233 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (2/3) ...edpipesplatform/splitout1
2013-10-31 18:33:28,233 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] starting step: (3/3) ...edpipesplatform/splitout2
2013-10-31 18:33:28,241 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:33:28,241 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:33:28,242 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:33:28,241 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:33:28,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0011 dst=null perm=null
2013-10-31 18:33:28,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:28,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:28,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:33:28,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:33:28,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,275 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar. blk_-3922365374298370577_1115
2013-10-31 18:33:28,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,277 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:47289 dest: /127.0.0.1:54365
2013-10-31 18:33:28,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:49919 dest: /127.0.0.1:34578
2013-10-31 18:33:28,280 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:47008 dest: /127.0.0.1:37740
2013-10-31 18:33:28,294 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47008, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3922365374298370577_1115, duration: 10312202
2013-10-31 18:33:28,294 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49919, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3922365374298370577_1115, duration: 11117163
2013-10-31 18:33:28,295 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,295 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47289, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3922365374298370577_1115, duration: 12313742
2013-10-31 18:33:28,296 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,297 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3922365374298370577_1115 terminating
2013-10-31 18:33:28,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:28,299 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar from client DFSClient_-1596270109
2013-10-31 18:33:28,299 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:33:28,301 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar. blk_3668603729858618955_1115
2013-10-31 18:33:28,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:43118 dest: /127.0.0.1:59471
2013-10-31 18:33:28,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:47010 dest: /127.0.0.1:37740
2013-10-31 18:33:28,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:47294 dest: /127.0.0.1:54365
2013-10-31 18:33:28,312 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47294, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3668603729858618955_1115, duration: 2880638
2013-10-31 18:33:28,313 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,313 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,313 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47010, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3668603729858618955_1115, duration: 3647443
2013-10-31 18:33:28,314 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,314 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43118, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3668603729858618955_1115, duration: 4693794
2013-10-31 18:33:28,315 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,315 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3668603729858618955_1115 terminating
2013-10-31 18:33:28,317 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar from client DFSClient_-1596270109
2013-10-31 18:33:28,317 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:33:28,318 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar. New replication is 10
2013-10-31 18:33:28,319 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:28,322 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar. New replication is 10
2013-10-31 18:33:28,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar dst=null perm=null
2013-10-31 18:33:28,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar dst=null perm=null
2013-10-31 18:33:28,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,332 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:33:28,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,336 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:33:28,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE dst=null perm=null
2013-10-31 18:33:28,339 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:33:28,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000 dst=null perm=null
2013-10-31 18:33:28,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE dst=null perm=null
2013-10-31 18:33:28,342 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:33:28,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000 dst=null perm=null
2013-10-31 18:33:28,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,410 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3922365374298370577_1115 to datanode(s) 127.0.0.1:59471
2013-10-31 18:33:28,411 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3668603729858618955_1115 to datanode(s) 127.0.0.1:34578
2013-10-31 18:33:28,411 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_7656384865086930476_1111
2013-10-31 18:33:28,412 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:28,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,872 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split. New replication is 10
2013-10-31 18:33:28,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,875 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split. New replication is 10
2013-10-31 18:33:28,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split dst=null perm=null
2013-10-31 18:33:28,879 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split. blk_2114727610416078497_1117
2013-10-31 18:33:28,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split dst=null perm=null
2013-10-31 18:33:28,881 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:47295 dest: /127.0.0.1:54365
2013-10-31 18:33:28,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:43122 dest: /127.0.0.1:59471
2013-10-31 18:33:28,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:49926 dest: /127.0.0.1:34578
2013-10-31 18:33:28,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2114727610416078497_1117 src: /127.0.0.1:47015 dest: /127.0.0.1:37740
2013-10-31 18:33:28,889 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47015, dest: /127.0.0.1:37740, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2114727610416078497_1117, duration: 65547
2013-10-31 18:33:28,890 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,890 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49926, dest: /127.0.0.1:34578, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2114727610416078497_1117, duration: 898385
2013-10-31 18:33:28,891 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,891 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43122, dest: /127.0.0.1:59471, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2114727610416078497_1117, duration: 1809017
2013-10-31 18:33:28,892 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47295, dest: /127.0.0.1:54365, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2114727610416078497_1117, duration: 2727496
2013-10-31 18:33:28,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2114727610416078497_1117 terminating
2013-10-31 18:33:28,895 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,897 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2114727610416078497_1117 size 354
2013-10-31 18:33:28,899 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split from client DFSClient_-1596270109
2013-10-31 18:33:28,899 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split is closed by DFSClient_-1596270109
2013-10-31 18:33:28,899 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split. blk_382693967759542507_1117
2013-10-31 18:33:28,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:49928 dest: /127.0.0.1:34578
2013-10-31 18:33:28,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:47300 dest: /127.0.0.1:54365
2013-10-31 18:33:28,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:47018 dest: /127.0.0.1:37740
2013-10-31 18:33:28,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_382693967759542507_1117 src: /127.0.0.1:43128 dest: /127.0.0.1:59471
2013-10-31 18:33:28,912 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43128, dest: /127.0.0.1:59471, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_382693967759542507_1117, duration: 91784
2013-10-31 18:33:28,912 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,913 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47018, dest: /127.0.0.1:37740, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_382693967759542507_1117, duration: 3193444
2013-10-31 18:33:28,913 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,913 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47300, dest: /127.0.0.1:54365, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_382693967759542507_1117, duration: 3996111
2013-10-31 18:33:28,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,914 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49928, dest: /127.0.0.1:34578, bytes: 354, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_382693967759542507_1117, duration: 4965647
2013-10-31 18:33:28,915 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,915 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_382693967759542507_1117 terminating
2013-10-31 18:33:28,918 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,919 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,919 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split from client DFSClient_-1596270109
2013-10-31 18:33:28,920 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split is closed by DFSClient_-1596270109
2013-10-31 18:33:28,920 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_382693967759542507_1117 size 354
2013-10-31 18:33:28,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,937 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo. blk_7462121373986728613_1119
2013-10-31 18:33:28,938 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:49932 dest: /127.0.0.1:34578
2013-10-31 18:33:28,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:43130 dest: /127.0.0.1:59471
2013-10-31 18:33:28,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7462121373986728613_1119 src: /127.0.0.1:47305 dest: /127.0.0.1:54365
2013-10-31 18:33:28,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47305, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7462121373986728613_1119, duration: 66350
2013-10-31 18:33:28,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43130, dest: /127.0.0.1:59471, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7462121373986728613_1119, duration: 842861
2013-10-31 18:33:28,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,946 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49932, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7462121373986728613_1119, duration: 1639037
2013-10-31 18:33:28,946 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7462121373986728613_1119 terminating
2013-10-31 18:33:28,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,949 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:33:28,949 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:33:28,950 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7462121373986728613_1119 size 45
2013-10-31 18:33:28,951 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo. blk_-2323677095253206755_1119
2013-10-31 18:33:28,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:49935 dest: /127.0.0.1:34578
2013-10-31 18:33:28,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:47307 dest: /127.0.0.1:54365
2013-10-31 18:33:28,956 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2323677095253206755_1119 src: /127.0.0.1:47025 dest: /127.0.0.1:37740
2013-10-31 18:33:28,959 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47025, dest: /127.0.0.1:37740, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2323677095253206755_1119, duration: 68331
2013-10-31 18:33:28,959 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,959 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47307, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2323677095253206755_1119, duration: 1001042
2013-10-31 18:33:28,960 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,960 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49935, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2323677095253206755_1119, duration: 1918657
2013-10-31 18:33:28,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2323677095253206755_1119 terminating
2013-10-31 18:33:28,962 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,963 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,964 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:33:28,964 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:33:28,965 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2323677095253206755_1119 size 45
2013-10-31 18:33:28,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,987 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml. blk_-2009759733485207989_1121
2013-10-31 18:33:28,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:28,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:43135 dest: /127.0.0.1:59471
2013-10-31 18:33:28,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:47310 dest: /127.0.0.1:54365
2013-10-31 18:33:28,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2009759733485207989_1121 src: /127.0.0.1:49940 dest: /127.0.0.1:34578
2013-10-31 18:33:28,995 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49940, dest: /127.0.0.1:34578, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2009759733485207989_1121, duration: 157061
2013-10-31 18:33:28,995 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:28,995 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47310, dest: /127.0.0.1:54365, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2009759733485207989_1121, duration: 1037573
2013-10-31 18:33:28,996 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:28,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:28,996 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43135, dest: /127.0.0.1:59471, bytes: 27802, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2009759733485207989_1121, duration: 1916802
2013-10-31 18:33:28,996 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:28,997 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2009759733485207989_1121 terminating
2013-10-31 18:33:29,000 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2009759733485207989_1121 size 27802
2013-10-31 18:33:29,000 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml from client DFSClient_-1596270109
2013-10-31 18:33:29,001 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:33:29,005 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml. blk_5001471268516047652_1121
2013-10-31 18:33:29,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml dst=null perm=null
2013-10-31 18:33:29,015 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47313, bytes: 28022, op: HDFS_READ, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2009759733485207989_1121, duration: 405352
2013-10-31 18:33:29,035 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0013: nMaps=1 nReduces=1 max=-1
2013-10-31 18:33:29,035 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0013 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:33:29,035 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0013
2013-10-31 18:33:29,035 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0013 RESULT=SUCCESS
2013-10-31 18:33:29,036 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0013
2013-10-31 18:33:29,037 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0013
2013-10-31 18:33:29,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:49943 dest: /127.0.0.1:34578
2013-10-31 18:33:29,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:43141 dest: /127.0.0.1:59471
2013-10-31 18:33:29,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5001471268516047652_1121 src: /127.0.0.1:47316 dest: /127.0.0.1:54365
2013-10-31 18:33:29,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47316, dest: /127.0.0.1:54365, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5001471268516047652_1121, duration: 1101275
2013-10-31 18:33:29,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,048 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3668603729858618955_1115 to 127.0.0.1:34578
2013-10-31 18:33:29,049 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43141, dest: /127.0.0.1:59471, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5001471268516047652_1121, duration: 711637
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data4/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:29,049 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data4/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data3/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:29,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data3/current/blk_1473407138158581377
2013-10-31 18:33:29,050 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49943, dest: /127.0.0.1:34578, bytes: 26964, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5001471268516047652_1121, duration: 1289409
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data4/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:29,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,049 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data4/current/blk_-5658866385858982902
2013-10-31 18:33:29,052 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml from client DFSClient_-1596270109
2013-10-31 18:33:29,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3668603729858618955_1115 src: /127.0.0.1:49946 dest: /127.0.0.1:34578
2013-10-31 18:33:29,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data4/current/blk_-1646609186769667995
2013-10-31 18:33:29,050 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5001471268516047652_1121 terminating
2013-10-31 18:33:29,053 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data4/current/blk_4636075907529433197
2013-10-31 18:33:29,052 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:33:29,052 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3668603729858618955_1115 to /127.0.0.1:34578
2013-10-31 18:33:29,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3668603729858618955_1115 src: /127.0.0.1:49946 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:33:29,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5001471268516047652_1121 size 26964
2013-10-31 18:33:29,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3668603729858618955_1115 size 238055
2013-10-31 18:33:29,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data6/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:29,778 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data6/current/blk_7656384865086930476
2013-10-31 18:33:30,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml dst=null perm=null
2013-10-31 18:33:30,053 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49948, bytes: 27176, op: HDFS_READ, cliID: DFSClient_-816942347, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5001471268516047652_1121, duration: 406492
2013-10-31 18:33:30,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,063 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml. blk_5588664725749623445_1123
2013-10-31 18:33:30,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:47320 dest: /127.0.0.1:54365
2013-10-31 18:33:30,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:49950 dest: /127.0.0.1:34578
2013-10-31 18:33:30,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5588664725749623445_1123 src: /127.0.0.1:43148 dest: /127.0.0.1:59471
2013-10-31 18:33:30,072 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43148, dest: /127.0.0.1:59471, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5588664725749623445_1123, duration: 405874
2013-10-31 18:33:30,073 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,073 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49950, dest: /127.0.0.1:34578, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5588664725749623445_1123, duration: 1225208
2013-10-31 18:33:30,074 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,074 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47320, dest: /127.0.0.1:54365, bytes: 27867, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5588664725749623445_1123, duration: 2205951
2013-10-31 18:33:30,075 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5588664725749623445_1123 terminating
2013-10-31 18:33:30,076 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,077 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml from client DFSClient_-1622110505
2013-10-31 18:33:30,077 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_conf.xml is closed by DFSClient_-1622110505
2013-10-31 18:33:30,078 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,079 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5588664725749623445_1123 size 27867
2013-10-31 18:33:30,097 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0012: nMaps=1 nReduces=0 max=-1
2013-10-31 18:33:30,099 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0012 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:33:30,099 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0012
2013-10-31 18:33:30,099 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0012 RESULT=SUCCESS
2013-10-31 18:33:30,099 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0012
2013-10-31 18:33:30,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,102 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken. blk_-5501218942350876546_1124
2013-10-31 18:33:30,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:49952 dest: /127.0.0.1:34578
2013-10-31 18:33:30,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:43150 dest: /127.0.0.1:59471
2013-10-31 18:33:30,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5501218942350876546_1124 src: /127.0.0.1:47325 dest: /127.0.0.1:54365
2013-10-31 18:33:30,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,112 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47325, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5501218942350876546_1124, duration: 1106070
2013-10-31 18:33:30,113 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,113 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43150, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5501218942350876546_1124, duration: 1857829
2013-10-31 18:33:30,113 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,114 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49952, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5501218942350876546_1124, duration: 2726577
2013-10-31 18:33:30,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5501218942350876546_1124 terminating
2013-10-31 18:33:30,116 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [output1+output2] submitted hadoop job: job_20131031182606197_0012
2013-10-31 18:33:30,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,117 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken from client DFSClient_-1596270109
2013-10-31 18:33:30,117 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:33:30,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5501218942350876546_1124 size 116
2013-10-31 18:33:30,120 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken
2013-10-31 18:33:30,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.splitmetainfo dst=null perm=null
2013-10-31 18:33:30,123 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47326, bytes: 49, op: HDFS_READ, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7462121373986728613_1119, duration: 123660
2013-10-31 18:33:30,123 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0013 = 1697. Number of splits = 1
2013-10-31 18:33:30,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,124 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0013_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,125 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0013 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:33:30,125 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0013 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:33:30,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,132 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml. blk_7711436382493962850_1126
2013-10-31 18:33:30,133 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:49956 dest: /127.0.0.1:34578
2013-10-31 18:33:30,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:43154 dest: /127.0.0.1:59471
2013-10-31 18:33:30,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7711436382493962850_1126 src: /127.0.0.1:47046 dest: /127.0.0.1:37740
2013-10-31 18:33:30,138 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47046, dest: /127.0.0.1:37740, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7711436382493962850_1126, duration: 589591
2013-10-31 18:33:30,139 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,139 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43154, dest: /127.0.0.1:59471, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7711436382493962850_1126, duration: 1234062
2013-10-31 18:33:30,140 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,140 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49956, dest: /127.0.0.1:34578, bytes: 27029, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7711436382493962850_1126, duration: 2163226
2013-10-31 18:33:30,140 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7711436382493962850_1126 terminating
2013-10-31 18:33:30,144 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,144 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,145 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7711436382493962850_1126 size 27029
2013-10-31 18:33:30,145 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml from client DFSClient_-816942347
2013-10-31 18:33:30,145 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_conf.xml is closed by DFSClient_-816942347
2013-10-31 18:33:30,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:30,154 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken. blk_-5293425425470303312_1127
2013-10-31 18:33:30,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:47047 dest: /127.0.0.1:37740
2013-10-31 18:33:30,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:47331 dest: /127.0.0.1:54365
2013-10-31 18:33:30,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5293425425470303312_1127 src: /127.0.0.1:43158 dest: /127.0.0.1:59471
2013-10-31 18:33:30,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43158, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5293425425470303312_1127, duration: 28161
2013-10-31 18:33:30,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,164 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47331, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5293425425470303312_1127, duration: 1450047
2013-10-31 18:33:30,165 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,165 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47047, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5293425425470303312_1127, duration: 1866471
2013-10-31 18:33:30,166 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5293425425470303312_1127 terminating
2013-10-31 18:33:30,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,169 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5293425425470303312_1127 size 116
2013-10-31 18:33:30,169 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken from client DFSClient_-1596270109
2013-10-31 18:33:30,169 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:33:30,173 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken
2013-10-31 18:33:30,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.splitmetainfo dst=null perm=null
2013-10-31 18:33:30,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47333, bytes: 49, op: HDFS_READ, cliID: DFSClient_-816942347, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2323677095253206755_1119, duration: 122684
2013-10-31 18:33:30,177 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0012 = 1697. Number of splits = 1
2013-10-31 18:33:30,177 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,177 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,177 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0012_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:33:30,178 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0012 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:33:30,178 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0012 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:33:30,211 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3922365374298370577_1115 to 127.0.0.1:59471
2013-10-31 18:33:30,212 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3922365374298370577_1115 to /127.0.0.1:59471
2013-10-31 18:33:30,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3922365374298370577_1115 src: /127.0.0.1:43160 dest: /127.0.0.1:59471
2013-10-31 18:33:30,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3922365374298370577_1115 src: /127.0.0.1:43160 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:33:30,216 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3922365374298370577_1115 size 238055
2013-10-31 18:33:31,150 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0012_m_000002_0' to tip task_20131031182606197_0012_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:31,156 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0011_m_000003_0'
2013-10-31 18:33:31,158 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:33:31,158 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,158 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012/jobToken dst=null perm=null
2013-10-31 18:33:31,167 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47052, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5293425425470303312_1127, duration: 313318
2013-10-31 18:33:31,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.xml dst=null perm=null
2013-10-31 18:33:31,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43163, bytes: 27176, op: HDFS_READ, cliID: DFSClient_221142571, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5001471268516047652_1121, duration: 445442
2013-10-31 18:33:31,207 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:33:31,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.jar dst=null perm=null
2013-10-31 18:33:31,232 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0013_m_000002_0' to tip task_20131031182606197_0013_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:31,238 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:33:31,239 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,239 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000002_0 which needs 1 slots
2013-10-31 18:33:31,240 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47338, bytes: 239915, op: HDFS_READ, cliID: DFSClient_221142571, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3668603729858618955_1115, duration: 1455085
2013-10-31 18:33:31,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013/jobToken dst=null perm=null
2013-10-31 18:33:31,247 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49968, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5501218942350876546_1124, duration: 279867
2013-10-31 18:33:31,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.xml dst=null perm=null
2013-10-31 18:33:31,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49970, bytes: 28022, op: HDFS_READ, cliID: DFSClient_2097362858, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2009759733485207989_1121, duration: 379586
2013-10-31 18:33:31,282 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:33:31,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.jar dst=null perm=null
2013-10-31 18:33:31,299 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47342, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2097362858, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3922365374298370577_1115, duration: 530683
2013-10-31 18:33:31,307 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0012_m_-357367951
2013-10-31 18:33:31,308 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0012_m_-357367951 spawned.
2013-10-31 18:33:31,309 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0012/attempt_20131031182606197_0012_m_000002_0/taskjvm.sh
2013-10-31 18:33:31,384 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0011_m_-575970400
2013-10-31 18:33:31,391 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group22844 with signal TERM. Exit code 0
2013-10-31 18:33:31,391 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_m_932760728
2013-10-31 18:33:31,392 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_m_932760728 spawned.
2013-10-31 18:33:31,393 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_m_000002_0/taskjvm.sh
2013-10-31 18:33:31,413 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_7656384865086930476_1111 blk_1473407138158581377_1107 blk_4636075907529433197_1106 blk_-5658866385858982902_1108 blk_-1646609186769667995_1105
2013-10-31 18:33:31,413 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_7656384865086930476_1111
2013-10-31 18:33:31,472 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:31,473 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:31,473 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:31,473 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_-575970400 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:33:33,176 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5658866385858982902_1108 file build/test/data/dfs/data/data1/current/blk_-5658866385858982902 for deletion
2013-10-31 18:33:33,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1646609186769667995_1105 file build/test/data/dfs/data/data2/current/blk_-1646609186769667995 for deletion
2013-10-31 18:33:33,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5658866385858982902_1108 at file build/test/data/dfs/data/data1/current/blk_-5658866385858982902
2013-10-31 18:33:33,177 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1473407138158581377_1107 file build/test/data/dfs/data/data2/current/blk_1473407138158581377 for deletion
2013-10-31 18:33:33,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1646609186769667995_1105 at file build/test/data/dfs/data/data2/current/blk_-1646609186769667995
2013-10-31 18:33:33,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4636075907529433197_1106 file build/test/data/dfs/data/data1/current/blk_4636075907529433197 for deletion
2013-10-31 18:33:33,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1473407138158581377_1107 at file build/test/data/dfs/data/data2/current/blk_1473407138158581377
2013-10-31 18:33:33,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4636075907529433197_1106 at file build/test/data/dfs/data/data1/current/blk_4636075907529433197
2013-10-31 18:33:33,178 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data1/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:33,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data1/current/blk_7656384865086930476
2013-10-31 18:33:33,227 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,227 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0011_m_000004_0 not found in cache
2013-10-31 18:33:33,228 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813228
2013-10-31 18:33:33,249 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7656384865086930476_1111 file build/test/data/dfs/data/data8/current/blk_7656384865086930476 for deletion
2013-10-31 18:33:33,249 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7656384865086930476_1111 at file build/test/data/dfs/data/data8/current/blk_7656384865086930476
2013-10-31 18:33:33,263 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,263 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:33,264 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813264
2013-10-31 18:33:33,264 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330813264
2013-10-31 18:33:33,306 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_r_1328977401 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,317 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23235 with signal TERM. Exit code 0
2013-10-31 18:33:33,501 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_1263282871 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,503 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:33,503 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:33,503 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:33,503 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_r_1328977401 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:33,512 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23374 with signal TERM. Exit code 0
2013-10-31 18:33:33,682 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:33,683 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:33,683 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:33,683 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_1263282871 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:33,945 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_-538677001 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,957 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23068 with signal TERM. Exit code 0
2013-10-31 18:33:33,977 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_1012864139 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:33,986 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23098 with signal TERM. Exit code 0
2013-10-31 18:33:34,190 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:34,190 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:34,191 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:34,191 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_1012864139 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:34,197 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:34,197 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:34,197 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:34,197 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_-538677001 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:35,669 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_-357367951 given task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:36,158 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0011
2013-10-31 18:33:36,159 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0011 for user-log deletion with retainTimeStamp:1383330816159
2013-10-31 18:33:37,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:37,344 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0011_m_116991220 since job job_20131031182606197_0011 is dead
2013-10-31 18:33:37,353 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23191 with signal TERM. Exit code 0
2013-10-31 18:33:37,544 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:37,544 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:37,544 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:37,545 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0011_m_116991220 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:37,669 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_932760728 given task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:38,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:40,150 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000002_0 0.0% setup
2013-10-31 18:33:40,153 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000002_0 is done.
2013-10-31 18:33:40,153 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000002_0 was -1
2013-10-31 18:33:40,153 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:40,164 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000002_0' has completed task_20131031182606197_0012_m_000002 successfully.
2013-10-31 18:33:40,166 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0012_m_000000_0' to tip task_20131031182606197_0012_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:40,166 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0012_m_000000
2013-10-31 18:33:40,167 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:40,167 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000000_0 which needs 1 slots
2013-10-31 18:33:40,168 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000000_0 which needs 1 slots
2013-10-31 18:33:40,230 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0012_m_18846988
2013-10-31 18:33:40,231 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0012_m_18846988 spawned.
2013-10-31 18:33:40,234 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0012/attempt_20131031182606197_0012_m_000000_0/taskjvm.sh
2013-10-31 18:33:41,067 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_18846988 given task: attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,138 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000002_0 0.0% setup
2013-10-31 18:33:41,140 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000002_0 is done.
2013-10-31 18:33:41,140 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000002_0 was -1
2013-10-31 18:33:41,140 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:41,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012/job.split dst=null perm=null
2013-10-31 18:33:41,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49981, bytes: 358, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_382693967759542507_1117, duration: 132820
2013-10-31 18:33:41,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000 dst=null perm=null
2013-10-31 18:33:41,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:49982, bytes: 1713, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1328316139791502870_1112, duration: 367555
2013-10-31 18:33:41,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:41,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:41,905 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000. blk_7101250285511173582_1128
2013-10-31 18:33:41,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:47354 dest: /127.0.0.1:54365
2013-10-31 18:33:41,938 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:43181 dest: /127.0.0.1:59471
2013-10-31 18:33:41,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7101250285511173582_1128 src: /127.0.0.1:49985 dest: /127.0.0.1:34578
2013-10-31 18:33:41,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49985, dest: /127.0.0.1:34578, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7101250285511173582_1128, duration: 1699605
2013-10-31 18:33:41,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43181, dest: /127.0.0.1:59471, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 1738076
2013-10-31 18:33:41,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,945 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47354, dest: /127.0.0.1:54365, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0012_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7101250285511173582_1128, duration: 2633154
2013-10-31 18:33:41,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7101250285511173582_1128 terminating
2013-10-31 18:33:41,946 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:41,947 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:41,947 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,947 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:41,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7101250285511173582_1128 size 1490
2013-10-31 18:33:42,010 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0012_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:42,010 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000000_0 0.0%
2013-10-31 18:33:43,171 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0012_m_000000_0
2013-10-31 18:33:43,250 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000002_0' has completed task_20131031182606197_0013_m_000002 successfully.
2013-10-31 18:33:43,253 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0013_m_000000_0' to tip task_20131031182606197_0013_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:43,254 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0013_m_000000
2013-10-31 18:33:43,256 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:43,256 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000000_0 which needs 1 slots
2013-10-31 18:33:43,256 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000000_0 which needs 1 slots
2013-10-31 18:33:43,288 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_m_-137784207
2013-10-31 18:33:43,289 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_m_-137784207 spawned.
2013-10-31 18:33:43,291 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_m_000000_0/taskjvm.sh
2013-10-31 18:33:44,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0 dst=null perm=null
2013-10-31 18:33:44,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:44,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:44,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary/_attempt_20131031182606197_0012_m_000000_0 dst=null perm=null
2013-10-31 18:33:44,150 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_-137784207 given task: attempt_20131031182606197_0013_m_000000_0
2013-10-31 18:33:44,497 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000:0+1697
2013-10-31 18:33:44,498 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000000_0 is done.
2013-10-31 18:33:44,498 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000000_0 was -1
2013-10-31 18:33:44,499 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:44,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013/job.split dst=null perm=null
2013-10-31 18:33:44,641 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47077, bytes: 358, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0013_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2114727610416078497_1117, duration: 149868
2013-10-31 18:33:44,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000 dst=null perm=null
2013-10-31 18:33:44,677 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47361, bytes: 1713, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0013_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1328316139791502870_1112, duration: 145169
2013-10-31 18:33:45,168 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:45,168 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0012_m_000002_0
2013-10-31 18:33:45,168 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000002_0 not found in cache
2013-10-31 18:33:46,174 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000000_0' has completed task_20131031182606197_0012_m_000000 successfully.
2013-10-31 18:33:46,178 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0012_m_000001_0' to tip task_20131031182606197_0012_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:33:46,180 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0012_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:33:46,181 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0012_m_000001_0 which needs 1 slots
2013-10-31 18:33:46,181 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0012_m_000001_0 which needs 1 slots
2013-10-31 18:33:46,210 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0012/attempt_20131031182606197_0012_m_000001_0. Attempting to reuse: jvm_20131031182606197_0012_m_18846988
2013-10-31 18:33:46,550 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0012_m_18846988 given task: attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,668 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000001_0 0.0%
2013-10-31 18:33:46,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary dst=null perm=null
2013-10-31 18:33:46,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:46,708 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS from client DFSClient_attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,709 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0012_m_000001_0
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3668603729858618955 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_382693967759542507 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:46,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2323677095253206755 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:46,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:33:46,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5001471268516047652 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:46,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0012 dst=null perm=null
2013-10-31 18:33:47,572 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE/part-00000:0+1697
2013-10-31 18:33:47,575 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000000_0 is done.
2013-10-31 18:33:47,576 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000000_0 was 1593
2013-10-31 18:33:47,576 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:48,256 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:48,256 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0013_m_000002_0
2013-10-31 18:33:48,257 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0013_m_000002_0 not found in cache
2013-10-31 18:33:49,262 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000000_0' has completed task_20131031182606197_0013_m_000000 successfully.
2013-10-31 18:33:49,264 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0013_r_000000_0' to tip task_20131031182606197_0013_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:33:49,266 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:33:49,266 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_r_000000_0 which needs 1 slots
2013-10-31 18:33:49,267 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_r_000000_0 which needs 1 slots
2013-10-31 18:33:49,304 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0013_r_-2042360792
2013-10-31 18:33:49,304 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0013_r_-2042360792 spawned.
2013-10-31 18:33:49,306 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0013/attempt_20131031182606197_0013_r_000000_0/taskjvm.sh
2013-10-31 18:33:49,417 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5001471268516047652_1121 blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:49,417 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:49,639 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0012_m_000001_0 0.0% cleanup
2013-10-31 18:33:49,640 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0012_m_000001_0 is done.
2013-10-31 18:33:49,640 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0012_m_000001_0 was -1
2013-10-31 18:33:49,640 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:33:50,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data4/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:50,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data4/current/blk_-2323677095253206755
2013-10-31 18:33:50,056 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data4/current/blk_382693967759542507 for deletion
2013-10-31 18:33:50,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data4/current/blk_382693967759542507
2013-10-31 18:33:50,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data4/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:50,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data4/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:50,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data4/current/blk_3668603729858618955
2013-10-31 18:33:50,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data4/current/blk_5001471268516047652
2013-10-31 18:33:50,150 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_r_-2042360792 given task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:51,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data8/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:51,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data7/current/blk_382693967759542507 for deletion
2013-10-31 18:33:51,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data8/current/blk_-2323677095253206755
2013-10-31 18:33:51,256 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data7/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:51,256 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data7/current/blk_382693967759542507
2013-10-31 18:33:51,256 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data7/current/blk_3668603729858618955
2013-10-31 18:33:52,188 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0012_m_000001_0' has completed task_20131031182606197_0012_m_000001 successfully.
2013-10-31 18:33:52,189 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0012 has completed successfully.
2013-10-31 18:33:52,191 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0012,submitTime=1383244410043,launchTime=1383244410178,firstMapTaskLaunchTime=1383244420166,firstJobSetupTaskLaunchTime=1383244411150,firstJobCleanupTaskLaunchTime=1383244426177,finishTime=1383244432189,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=16,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/A025C715160B43E7B09224193417545A] output1+output2/(2/3) ...edpipesplatform/splitout1
2013-10-31 18:33:52,196 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7. blk_2600348140943850569_1129
2013-10-31 18:33:52,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:47366 dest: /127.0.0.1:54365
2013-10-31 18:33:52,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:47084 dest: /127.0.0.1:37740
2013-10-31 18:33:52,202 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2600348140943850569_1129 src: /127.0.0.1:43194 dest: /127.0.0.1:59471
2013-10-31 18:33:52,211 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43194, dest: /127.0.0.1:59471, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2600348140943850569_1129, duration: 5659993
2013-10-31 18:33:52,212 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,212 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,212 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47084, dest: /127.0.0.1:37740, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2600348140943850569_1129, duration: 4546318
2013-10-31 18:33:52,213 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,213 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47366, dest: /127.0.0.1:54365, bytes: 11380, op: HDFS_WRITE, cliID: DFSClient_-816942347, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2600348140943850569_1129, duration: 4233243
2013-10-31 18:33:52,214 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2600348140943850569_1129 terminating
2013-10-31 18:33:52,217 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,218 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 from client DFSClient_-816942347
2013-10-31 18:33:52,219 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_logs/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 is closed by DFSClient_-816942347
2013-10-31 18:33:52,219 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2600348140943850569_1129 size 11380
2013-10-31 18:33:52,225 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0012_1383244410043_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2FA025C715160B43E7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:52,226 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000000_0'
2013-10-31 18:33:52,226 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000001_0'
2013-10-31 18:33:52,226 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0012_m_000002_0'
2013-10-31 18:33:52,227 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:33:52,227 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:33:52,228 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5293425425470303312 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:33:52,231 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0012_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:33:52,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0012 dst=null perm=null
2013-10-31 18:33:52,269 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,269 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,287 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,287 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,288 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:52,288 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0012 being deleted.
2013-10-31 18:33:52,418 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_5001471268516047652_1121 blk_382693967759542507_1117 blk_3668603729858618955_1115 blk_-2323677095253206755_1119
2013-10-31 18:33:52,418 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5001471268516047652_1121 blk_-5293425425470303312_1127 blk_382693967759542507_1117 blk_3668603729858618955_1115
2013-10-31 18:33:53,786 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data5/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:53,787 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data6/current/blk_382693967759542507 for deletion
2013-10-31 18:33:53,787 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data5/current/blk_-5293425425470303312
2013-10-31 18:33:53,787 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data6/current/blk_382693967759542507
2013-10-31 18:33:53,787 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data6/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:53,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data5/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:53,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data6/current/blk_3668603729858618955
2013-10-31 18:33:53,788 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data5/current/blk_5001471268516047652
2013-10-31 18:33:54,183 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2323677095253206755_1119 file build/test/data/dfs/data/data2/current/blk_-2323677095253206755 for deletion
2013-10-31 18:33:54,183 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_382693967759542507_1117 file build/test/data/dfs/data/data2/current/blk_382693967759542507 for deletion
2013-10-31 18:33:54,183 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2323677095253206755_1119 at file build/test/data/dfs/data/data2/current/blk_-2323677095253206755
2013-10-31 18:33:54,184 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3668603729858618955_1115 file build/test/data/dfs/data/data1/current/blk_3668603729858618955 for deletion
2013-10-31 18:33:54,184 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_382693967759542507_1117 at file build/test/data/dfs/data/data2/current/blk_382693967759542507
2013-10-31 18:33:54,184 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5001471268516047652_1121 file build/test/data/dfs/data/data2/current/blk_5001471268516047652 for deletion
2013-10-31 18:33:54,184 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3668603729858618955_1115 at file build/test/data/dfs/data/data1/current/blk_3668603729858618955
2013-10-31 18:33:54,184 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5001471268516047652_1121 at file build/test/data/dfs/data/data2/current/blk_5001471268516047652
2013-10-31 18:33:55,419 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-5293425425470303312_1127
2013-10-31 18:33:55,419 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-5293425425470303312_1127
2013-10-31 18:33:55,812 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49036, bytes: 1593, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0013_m_000000_0, duration: 7790027
2013-10-31 18:33:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:33:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,037 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,042 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,048 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:33:56,048 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:33:56,057 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data3/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:56,058 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data3/current/blk_-5293425425470303312
2013-10-31 18:33:56,628 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,673 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,731 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:56,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:56,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:56,943 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000. blk_-5006662988950646824_1130
2013-10-31 18:33:56,965 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:43198 dest: /127.0.0.1:59471
2013-10-31 18:33:56,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:47373 dest: /127.0.0.1:54365
2013-10-31 18:33:56,968 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5006662988950646824_1130 src: /127.0.0.1:50003 dest: /127.0.0.1:34578
2013-10-31 18:33:56,970 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50003, dest: /127.0.0.1:34578, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5006662988950646824_1130, duration: 1191607
2013-10-31 18:33:56,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,970 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47373, dest: /127.0.0.1:54365, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5006662988950646824_1130, duration: 1546070
2013-10-31 18:33:56,970 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,971 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43198, dest: /127.0.0.1:59471, bytes: 1490, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0013_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5006662988950646824_1130, duration: 1847252
2013-10-31 18:33:56,971 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5006662988950646824_1130 terminating
2013-10-31 18:33:56,972 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5006662988950646824_1130 size 1490
2013-10-31 18:33:56,975 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:56,976 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:57,021 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0013_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:33:57,021 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:33:57,228 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0012
2013-10-31 18:33:57,228 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000000_0 not found in cache
2013-10-31 18:33:57,228 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0012_m_000001_0 not found in cache
2013-10-31 18:33:57,229 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0012 for user-log deletion with retainTimeStamp:1383330837229
2013-10-31 18:33:57,257 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5293425425470303312_1127 file build/test/data/dfs/data/data8/current/blk_-5293425425470303312 for deletion
2013-10-31 18:33:57,257 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5293425425470303312_1127 at file build/test/data/dfs/data/data8/current/blk_-5293425425470303312
2013-10-31 18:33:57,279 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0012_m_-357367951 since job job_20131031182606197_0012 is dead
2013-10-31 18:33:57,289 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23669 with signal TERM. Exit code 0
2013-10-31 18:33:57,457 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:57,457 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:57,457 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:57,458 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0012_m_-357367951 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:33:57,669 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0012_m_18846988 since job job_20131031182606197_0012 is dead
2013-10-31 18:33:57,679 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23799 with signal TERM. Exit code 0
2013-10-31 18:33:57,854 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:33:57,854 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:33:57,854 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:33:57,854 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0012_m_18846988 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:33:58,276 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0013_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:33:58,277 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:33:59,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0 dst=null perm=null
2013-10-31 18:33:59,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:33:59,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:33:59,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary/_attempt_20131031182606197_0013_r_000000_0 dst=null perm=null
2013-10-31 18:33:59,680 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:59,683 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_r_000000_0 1.0% reduce > reduce
2013-10-31 18:33:59,683 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_r_000000_0 is done.
2013-10-31 18:33:59,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_r_000000_0 was -1
2013-10-31 18:33:59,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:01,278 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_r_000000_0' has completed task_20131031182606197_0013_r_000000 successfully.
2013-10-31 18:34:01,282 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0013_m_000001_0' to tip task_20131031182606197_0013_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:01,284 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0013_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:01,284 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0013_m_000001_0 which needs 1 slots
2013-10-31 18:34:01,284 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0013_m_000001_0 which needs 1 slots
2013-10-31 18:34:01,303 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0013/attempt_20131031182606197_0013_m_000001_0. Attempting to reuse: jvm_20131031182606197_0013_m_932760728
2013-10-31 18:34:02,700 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0013_m_932760728 given task: attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,807 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000001_0 0.0%
2013-10-31 18:34:02,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary dst=null perm=null
2013-10-31 18:34:02,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:02,833 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS from client DFSClient_attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,833 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0013_m_000001_0
2013-10-31 18:34:02,843 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,843 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:02,843 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,843 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3922365374298370577 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,844 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,844 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,844 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,844 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2114727610416078497 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:02,845 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,845 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,845 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7462121373986728613 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:02,845 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:02,845 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:02,846 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2009759733485207989 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:03,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0013 dst=null perm=null
2013-10-31 18:34:04,420 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_-3922365374298370577_1115
2013-10-31 18:34:04,421 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_-3922365374298370577_1115
2013-10-31 18:34:05,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data3/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:05,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data3/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:05,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data3/current/blk_-3922365374298370577
2013-10-31 18:34:05,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data3/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:05,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data3/current/blk_-2009759733485207989
2013-10-31 18:34:05,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data3/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:05,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data3/current/blk_2114727610416078497
2013-10-31 18:34:05,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data3/current/blk_7462121373986728613
2013-10-31 18:34:05,778 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0013_m_000001_0 0.0% cleanup
2013-10-31 18:34:05,779 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0013_m_000001_0 is done.
2013-10-31 18:34:05,780 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0013_m_000001_0 was -1
2013-10-31 18:34:05,780 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:05,790 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data6/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:05,790 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data6/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:05,790 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data6/current/blk_-3922365374298370577
2013-10-31 18:34:05,791 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data5/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:05,791 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data6/current/blk_-2009759733485207989
2013-10-31 18:34:05,791 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data5/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:05,791 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data5/current/blk_2114727610416078497
2013-10-31 18:34:05,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data5/current/blk_7462121373986728613
2013-10-31 18:34:06,285 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:34:06,285 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0013_r_000000_0
2013-10-31 18:34:07,292 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0013_m_000001_0' has completed task_20131031182606197_0013_m_000001 successfully.
2013-10-31 18:34:07,293 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0013 has completed successfully.
2013-10-31 18:34:07,293 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0013,submitTime=1383244409006,launchTime=1383244410125,firstMapTaskLaunchTime=1383244423252,firstReduceTaskLaunchTime=1383244429263,firstJobSetupTaskLaunchTime=1383244411232,firstJobCleanupTaskLaunchTime=1383244441282,finishTime=1383244447293,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=18,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7906116797DA4A08896623D5F776AFB9/6EDCDC7890834C05829A183414FFE105] output1+output2/(3/3) ...edpipesplatform/splitout2
2013-10-31 18:34:07,301 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05. blk_-2235659000156106976_1131
2013-10-31 18:34:07,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:50006 dest: /127.0.0.1:34578
2013-10-31 18:34:07,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:47379 dest: /127.0.0.1:54365
2013-10-31 18:34:07,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2235659000156106976_1131 src: /127.0.0.1:47097 dest: /127.0.0.1:37740
2013-10-31 18:34:07,314 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47097, dest: /127.0.0.1:37740, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2235659000156106976_1131, duration: 1114285
2013-10-31 18:34:07,315 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,315 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47379, dest: /127.0.0.1:54365, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2235659000156106976_1131, duration: 5270222
2013-10-31 18:34:07,317 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,317 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50006, dest: /127.0.0.1:34578, bytes: 16994, op: HDFS_WRITE, cliID: DFSClient_-1622110505, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2235659000156106976_1131, duration: 7208215
2013-10-31 18:34:07,317 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,318 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2235659000156106976_1131 terminating
2013-10-31 18:34:07,321 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,322 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 from client DFSClient_-1622110505
2013-10-31 18:34:07,323 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_logs/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 is closed by DFSClient_-1622110505
2013-10-31 18:34:07,323 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2235659000156106976_1131 size 16994
2013-10-31 18:34:07,329 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0013_1383244409006_hadoop_%5B7906116797DA4A08896623D5F776AFB9%2F6EDCDC7890834C05 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:07,330 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000000_0'
2013-10-31 18:34:07,330 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000001_0'
2013-10-31 18:34:07,331 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_m_000002_0'
2013-10-31 18:34:07,332 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0013_r_000000_0'
2013-10-31 18:34:07,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,332 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5501218942350876546 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,333 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:07,333 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:07,333 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:07,333 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:07,335 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0013_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:07,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0013 dst=null perm=null
2013-10-31 18:34:07,342 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,342 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,342 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_548298036330803898 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:07,343 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,343 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,343 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3041080366967563833 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,343 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:07,343 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:07,344 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1328316139791502870 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:07,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5052270463_output1_490AA7C32270444A8A38D03E178744EE dst=null perm=null
2013-10-31 18:34:07,350 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/_temporary
2013-10-31 18:34:07,352 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/_temporary
2013-10-31 18:34:07,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1 dst=null perm=null
2013-10-31 18:34:07,372 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 dst=null perm=null
2013-10-31 18:34:07,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 dst=null perm=null
2013-10-31 18:34:07,380 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50011, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7101250285511173582_1128, duration: 1693917
2013-10-31 18:34:07,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2 dst=null perm=null
2013-10-31 18:34:07,399 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 dst=null perm=null
2013-10-31 18:34:07,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 dst=null perm=null
2013-10-31 18:34:07,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43209, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5006662988950646824_1130, duration: 192870
2013-10-31 18:34:07,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1 dst=null perm=null
2013-10-31 18:34:07,409 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 dst=null perm=null
2013-10-31 18:34:07,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 dst=null perm=null
2013-10-31 18:34:07,411 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43210, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 172337
2013-10-31 18:34:07,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2 dst=null perm=null
2013-10-31 18:34:07,419 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,427 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_548298036330803898_1113 blk_-5501218942350876546_1124 blk_-2009759733485207989_1121 blk_2114727610416078497_1117 blk_7462121373986728613_1119 blk_1328316139791502870_1112 blk_-3922365374298370577_1115 blk_-3041080366967563833_1110
2013-10-31 18:34:07,427 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_548298036330803898_1113 blk_2114727610416078497_1117 blk_-3922365374298370577_1115
2013-10-31 18:34:07,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 dst=null perm=null
2013-10-31 18:34:07,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 dst=null perm=null
2013-10-31 18:34:07,432 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50014, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5006662988950646824_1130, duration: 414477
2013-10-31 18:34:07,432 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitout2
2013-10-31 18:34:07,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2 dst=null perm=null
2013-10-31 18:34:07,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout2/part-00000 dst=null perm=null
2013-10-31 18:34:07,438 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitout1
2013-10-31 18:34:07,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47386, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5006662988950646824_1130, duration: 411439
2013-10-31 18:34:07,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1 dst=null perm=null
2013-10-31 18:34:07,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitout1/part-00000 dst=null perm=null
2013-10-31 18:34:07,446 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43213, bytes: 1502, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7101250285511173582_1128, duration: 399468
2013-10-31 18:34:07,467 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:34:07,468 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:34:07,490 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:34:07,490 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:34:07,491 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1"]
2013-10-31 18:34:07,491 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2"]
2013-10-31 18:34:07,491 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] parallel execution is enabled: true
2013-10-31 18:34:07,491 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting jobs: 2
2013-10-31 18:34:07,491 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] allocating threads: 2
2013-10-31 18:34:07,493 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/2) ...eldedpipesplatform/split2
2013-10-31 18:34:07,493 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/2) ...eldedpipesplatform/split1
2013-10-31 18:34:07,497 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:07,497 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:07,498 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:07,498 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:07,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:07,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:34:07,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:07,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:34:07,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,526 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar. blk_6248130088879987270_1132
2013-10-31 18:34:07,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:47105 dest: /127.0.0.1:37740
2013-10-31 18:34:07,530 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:50018 dest: /127.0.0.1:34578
2013-10-31 18:34:07,531 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:43216 dest: /127.0.0.1:59471
2013-10-31 18:34:07,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,540 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar. blk_5720203401911213791_1133
2013-10-31 18:34:07,544 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:50020 dest: /127.0.0.1:34578
2013-10-31 18:34:07,545 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43216, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6248130088879987270_1132, duration: 10183152
2013-10-31 18:34:07,546 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:47392 dest: /127.0.0.1:54365
2013-10-31 18:34:07,546 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50018, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6248130088879987270_1132, duration: 11695873
2013-10-31 18:34:07,547 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,547 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47105, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6248130088879987270_1132, duration: 12353445
2013-10-31 18:34:07,548 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6248130088879987270_1132 terminating
2013-10-31 18:34:07,548 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,552 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:07,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:43219 dest: /127.0.0.1:59471
2013-10-31 18:34:07,552 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:07,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:07,558 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar. New replication is 10
2013-10-31 18:34:07,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar dst=null perm=null
2013-10-31 18:34:07,564 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43219, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 8231419
2013-10-31 18:34:07,565 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,567 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47392, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5720203401911213791_1133, duration: 9595622
2013-10-31 18:34:07,567 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,567 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,567 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50020, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5720203401911213791_1133, duration: 11951688
2013-10-31 18:34:07,568 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5720203401911213791_1133 terminating
2013-10-31 18:34:07,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,572 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:07,572 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:07,572 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:07,573 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:07,578 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar. New replication is 10
2013-10-31 18:34:07,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar dst=null perm=null
2013-10-31 18:34:07,583 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,588 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:07,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:07,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,596 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:07,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:07,603 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split. New replication is 10
2013-10-31 18:34:07,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=null
2013-10-31 18:34:07,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,616 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split. blk_-6443718356478161979_1135
2013-10-31 18:34:07,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:47394 dest: /127.0.0.1:54365
2013-10-31 18:34:07,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:50024 dest: /127.0.0.1:34578
2013-10-31 18:34:07,623 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:47113 dest: /127.0.0.1:37740
2013-10-31 18:34:07,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6443718356478161979_1135 src: /127.0.0.1:43223 dest: /127.0.0.1:59471
2013-10-31 18:34:07,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:07,627 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split. New replication is 10
2013-10-31 18:34:07,628 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43223, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6443718356478161979_1135, duration: 103663
2013-10-31 18:34:07,628 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,629 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47113, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6443718356478161979_1135, duration: 1043053
2013-10-31 18:34:07,629 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,630 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50024, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 2055081
2013-10-31 18:34:07,630 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47394, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6443718356478161979_1135, duration: 3086975
2013-10-31 18:34:07,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6443718356478161979_1135 terminating
2013-10-31 18:34:07,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=null
2013-10-31 18:34:07,634 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,635 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split from client DFSClient_-1596270109
2013-10-31 18:34:07,635 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:07,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6443718356478161979_1135 size 1403
2013-10-31 18:34:07,640 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split. blk_6521390248325677253_1135
2013-10-31 18:34:07,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:50027 dest: /127.0.0.1:34578
2013-10-31 18:34:07,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:43225 dest: /127.0.0.1:59471
2013-10-31 18:34:07,645 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:47117 dest: /127.0.0.1:37740
2013-10-31 18:34:07,647 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6521390248325677253_1135 src: /127.0.0.1:47401 dest: /127.0.0.1:54365
2013-10-31 18:34:07,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47401, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6521390248325677253_1135, duration: 89565
2013-10-31 18:34:07,651 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,651 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47117, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 972070
2013-10-31 18:34:07,652 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,652 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43225, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6521390248325677253_1135, duration: 1928815
2013-10-31 18:34:07,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,653 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50027, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6521390248325677253_1135, duration: 2776152
2013-10-31 18:34:07,653 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,654 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6521390248325677253_1135 terminating
2013-10-31 18:34:07,655 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,656 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,656 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6521390248325677253_1135 size 1403
2013-10-31 18:34:07,679 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split from client DFSClient_-1596270109
2013-10-31 18:34:07,679 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:08,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,276 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo. blk_6337612719236416595_1137
2013-10-31 18:34:08,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:50031 dest: /127.0.0.1:34578
2013-10-31 18:34:08,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,279 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:47120 dest: /127.0.0.1:37740
2013-10-31 18:34:08,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6337612719236416595_1137 src: /127.0.0.1:47404 dest: /127.0.0.1:54365
2013-10-31 18:34:08,284 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47404, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6337612719236416595_1137, duration: 65702
2013-10-31 18:34:08,284 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,285 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47120, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6337612719236416595_1137, duration: 844033
2013-10-31 18:34:08,285 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50031, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6337612719236416595_1137, duration: 1931460
2013-10-31 18:34:08,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6337612719236416595_1137 terminating
2013-10-31 18:34:08,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,291 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,292 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6337612719236416595_1137 size 156
2013-10-31 18:34:08,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,328 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo. blk_6288635088291707302_1137
2013-10-31 18:34:08,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:50034 dest: /127.0.0.1:34578
2013-10-31 18:34:08,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:47123 dest: /127.0.0.1:37740
2013-10-31 18:34:08,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6288635088291707302_1137 src: /127.0.0.1:43233 dest: /127.0.0.1:59471
2013-10-31 18:34:08,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43233, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6288635088291707302_1137, duration: 68194
2013-10-31 18:34:08,336 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,336 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47123, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6288635088291707302_1137, duration: 876292
2013-10-31 18:34:08,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50034, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6288635088291707302_1137, duration: 1801239
2013-10-31 18:34:08,338 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6288635088291707302_1137 terminating
2013-10-31 18:34:08,341 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:08,342 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:08,342 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,343 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6288635088291707302_1137 size 156
2013-10-31 18:34:08,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,365 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml. blk_-7471099473439155231_1138
2013-10-31 18:34:08,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:43234 dest: /127.0.0.1:59471
2013-10-31 18:34:08,368 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:47126 dest: /127.0.0.1:37740
2013-10-31 18:34:08,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7471099473439155231_1138 src: /127.0.0.1:47410 dest: /127.0.0.1:54365
2013-10-31 18:34:08,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47410, dest: /127.0.0.1:54365, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7471099473439155231_1138, duration: 303453
2013-10-31 18:34:08,373 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,373 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47126, dest: /127.0.0.1:37740, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 1021676
2013-10-31 18:34:08,374 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,374 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43234, dest: /127.0.0.1:59471, bytes: 27389, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7471099473439155231_1138, duration: 1943737
2013-10-31 18:34:08,375 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7471099473439155231_1138 terminating
2013-10-31 18:34:08,375 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,377 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:08,377 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:08,377 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,378 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7471099473439155231_1138 size 27389
2013-10-31 18:34:08,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml dst=null perm=null
2013-10-31 18:34:08,396 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47129, bytes: 27605, op: HDFS_READ, cliID: DFSClient_1053356637, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 431494
2013-10-31 18:34:08,415 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0015: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:08,415 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0015 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:08,415 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0015
2013-10-31 18:34:08,415 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0015 RESULT=SUCCESS
2013-10-31 18:34:08,416 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0015
2013-10-31 18:34:08,417 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0015
2013-10-31 18:34:08,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,450 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml. blk_-2085394991921006793_1140
2013-10-31 18:34:08,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:50042 dest: /127.0.0.1:34578
2013-10-31 18:34:08,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:43240 dest: /127.0.0.1:59471
2013-10-31 18:34:08,455 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2085394991921006793_1140 src: /127.0.0.1:47132 dest: /127.0.0.1:37740
2013-10-31 18:34:08,459 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47132, dest: /127.0.0.1:37740, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2085394991921006793_1140, duration: 397563
2013-10-31 18:34:08,459 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,460 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43240, dest: /127.0.0.1:59471, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2085394991921006793_1140, duration: 2111481
2013-10-31 18:34:08,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50042, dest: /127.0.0.1:34578, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2085394991921006793_1140, duration: 2379856
2013-10-31 18:34:08,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,462 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2085394991921006793_1140 terminating
2013-10-31 18:34:08,464 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,464 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml from client DFSClient_1053356637
2013-10-31 18:34:08,465 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_conf.xml is closed by DFSClient_1053356637
2013-10-31 18:34:08,465 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2085394991921006793_1140 size 27454
2013-10-31 18:34:08,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,475 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken. blk_-7689919938199943373_1141
2013-10-31 18:34:08,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:43242 dest: /127.0.0.1:59471
2013-10-31 18:34:08,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:50046 dest: /127.0.0.1:34578
2013-10-31 18:34:08,480 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7689919938199943373_1141 src: /127.0.0.1:47135 dest: /127.0.0.1:37740
2013-10-31 18:34:08,483 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47135, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7689919938199943373_1141, duration: 67512
2013-10-31 18:34:08,484 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,484 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50046, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7689919938199943373_1141, duration: 871968
2013-10-31 18:34:08,485 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,485 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43242, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 2011737
2013-10-31 18:34:08,486 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7689919938199943373_1141 terminating
2013-10-31 18:34:08,487 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,489 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:08,490 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:08,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7689919938199943373_1141 size 116
2013-10-31 18:34:08,494 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken
2013-10-31 18:34:08,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.splitmetainfo dst=null perm=null
2013-10-31 18:34:08,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43245, bytes: 160, op: HDFS_READ, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6288635088291707302_1137, duration: 271530
2013-10-31 18:34:08,499 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0015 = 1449. Number of splits = 4
2013-10-31 18:34:08,500 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,500 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,500 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,501 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,502 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,503 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0015_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:08,503 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0015 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:08,503 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0015 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:08,690 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:08,691 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:08,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,934 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml. blk_-3748124066677778040_1142
2013-10-31 18:34:08,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:43246 dest: /127.0.0.1:59471
2013-10-31 18:34:08,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:50050 dest: /127.0.0.1:34578
2013-10-31 18:34:08,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3748124066677778040_1142 src: /127.0.0.1:47422 dest: /127.0.0.1:54365
2013-10-31 18:34:08,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47422, dest: /127.0.0.1:54365, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3748124066677778040_1142, duration: 159839
2013-10-31 18:34:08,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50050, dest: /127.0.0.1:34578, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3748124066677778040_1142, duration: 956407
2013-10-31 18:34:08,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,944 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43246, dest: /127.0.0.1:59471, bytes: 27393, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3748124066677778040_1142, duration: 2044818
2013-10-31 18:34:08,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3748124066677778040_1142 terminating
2013-10-31 18:34:08,949 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,949 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:08,950 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:08,950 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3748124066677778040_1142 size 27393
2013-10-31 18:34:08,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml dst=null perm=null
2013-10-31 18:34:08,964 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50053, bytes: 27609, op: HDFS_READ, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3748124066677778040_1142, duration: 406233
2013-10-31 18:34:08,981 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0014: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:08,981 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0014 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:08,981 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0014 RESULT=SUCCESS
2013-10-31 18:34:08,981 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0014
2013-10-31 18:34:08,981 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0014
2013-10-31 18:34:08,982 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0014
2013-10-31 18:34:08,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:08,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:09,005 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml. blk_1071781393642219275_1144
2013-10-31 18:34:09,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:43251 dest: /127.0.0.1:59471
2013-10-31 18:34:09,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:50055 dest: /127.0.0.1:34578
2013-10-31 18:34:09,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1071781393642219275_1144 src: /127.0.0.1:47144 dest: /127.0.0.1:37740
2013-10-31 18:34:09,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47144, dest: /127.0.0.1:37740, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1071781393642219275_1144, duration: 503655
2013-10-31 18:34:09,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50055, dest: /127.0.0.1:34578, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1071781393642219275_1144, duration: 1428614
2013-10-31 18:34:09,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43251, dest: /127.0.0.1:59471, bytes: 27458, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1071781393642219275_1144, duration: 2517784
2013-10-31 18:34:09,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1071781393642219275_1144 terminating
2013-10-31 18:34:09,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,019 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml from client DFSClient_-273342706
2013-10-31 18:34:09,020 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_conf.xml is closed by DFSClient_-273342706
2013-10-31 18:34:09,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1071781393642219275_1144 size 27458
2013-10-31 18:34:09,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:09,036 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken. blk_-9072395253391421232_1145
2013-10-31 18:34:09,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:47145 dest: /127.0.0.1:37740
2013-10-31 18:34:09,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:47429 dest: /127.0.0.1:54365
2013-10-31 18:34:09,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072395253391421232_1145 src: /127.0.0.1:50059 dest: /127.0.0.1:34578
2013-10-31 18:34:09,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50059, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9072395253391421232_1145, duration: 87775
2013-10-31 18:34:09,047 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,047 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47429, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072395253391421232_1145, duration: 998569
2013-10-31 18:34:09,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47145, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 1914480
2013-10-31 18:34:09,049 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9072395253391421232_1145 terminating
2013-10-31 18:34:09,051 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,051 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:09,052 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:09,052 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9072395253391421232_1145 size 116
2013-10-31 18:34:09,056 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken
2013-10-31 18:34:09,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.splitmetainfo dst=null perm=null
2013-10-31 18:34:09,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47431, bytes: 160, op: HDFS_READ, cliID: DFSClient_-273342706, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6337612719236416595_1137, duration: 263511
2013-10-31 18:34:09,063 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0014 = 1449. Number of splits = 4
2013-10-31 18:34:09,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,066 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0014_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:09,067 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0014 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:09,068 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0014 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:09,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data1/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:09,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data2/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:09,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data1/current/blk_-5501218942350876546
2013-10-31 18:34:09,187 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data2/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data2/current/blk_-3922365374298370577
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2009759733485207989_1121 file build/test/data/dfs/data/data1/current/blk_-2009759733485207989 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data2/current/blk_-3041080366967563833
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data1/current/blk_548298036330803898 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2009759733485207989_1121 at file build/test/data/dfs/data/data1/current/blk_-2009759733485207989
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data2/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data1/current/blk_548298036330803898
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data1/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data2/current/blk_1328316139791502870
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7462121373986728613_1119 file build/test/data/dfs/data/data1/current/blk_7462121373986728613 for deletion
2013-10-31 18:34:09,188 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data1/current/blk_2114727610416078497
2013-10-31 18:34:09,189 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7462121373986728613_1119 at file build/test/data/dfs/data/data1/current/blk_7462121373986728613
2013-10-31 18:34:09,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3922365374298370577_1115 file build/test/data/dfs/data/data8/current/blk_-3922365374298370577 for deletion
2013-10-31 18:34:09,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data7/current/blk_548298036330803898 for deletion
2013-10-31 18:34:09,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2114727610416078497_1117 file build/test/data/dfs/data/data8/current/blk_2114727610416078497 for deletion
2013-10-31 18:34:09,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data7/current/blk_548298036330803898
2013-10-31 18:34:09,260 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3922365374298370577_1115 at file build/test/data/dfs/data/data8/current/blk_-3922365374298370577
2013-10-31 18:34:09,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2114727610416078497_1117 at file build/test/data/dfs/data/data8/current/blk_2114727610416078497
2013-10-31 18:34:10,248 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0014_m_000005_0' to tip task_20131031182606197_0014_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:10,252 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:10,253 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,253 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:10,253 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,253 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0013 being deleted.
2013-10-31 18:34:10,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken dst=null perm=null
2013-10-31 18:34:10,258 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47149, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 311185
2013-10-31 18:34:10,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml dst=null perm=null
2013-10-31 18:34:10,267 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47434, bytes: 27609, op: HDFS_READ, cliID: DFSClient_2002082125, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3748124066677778040_1142, duration: 503032
2013-10-31 18:34:10,293 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:10,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar dst=null perm=null
2013-10-31 18:34:10,326 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2002082125, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6248130088879987270_1132, duration: 1485097
2013-10-31 18:34:10,338 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0015_m_000005_0' to tip task_20131031182606197_0015_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:10,347 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:10,347 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,347 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000005_0 which needs 1 slots
2013-10-31 18:34:10,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken dst=null perm=null
2013-10-31 18:34:10,355 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43262, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 284815
2013-10-31 18:34:10,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml dst=null perm=null
2013-10-31 18:34:10,365 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47155, bytes: 27605, op: HDFS_READ, cliID: DFSClient_-914049183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7471099473439155231_1138, duration: 394558
2013-10-31 18:34:10,387 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:10,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar dst=null perm=null
2013-10-31 18:34:10,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43265, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-914049183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 869888
2013-10-31 18:34:10,415 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:10,415 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-251095346 spawned.
2013-10-31 18:34:10,417 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000005_0/taskjvm.sh
2013-10-31 18:34:10,428 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_5720203401911213791_1133 to datanode(s) 127.0.0.1:37740
2013-10-31 18:34:10,428 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6248130088879987270_1132 to datanode(s) 127.0.0.1:54365
2013-10-31 18:34:10,429 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_548298036330803898_1113 blk_-5501218942350876546_1124 blk_1328316139791502870_1112 blk_-3041080366967563833_1110
2013-10-31 18:34:10,429 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-5501218942350876546_1124 blk_1328316139791502870_1112 blk_-3041080366967563833_1110
2013-10-31 18:34:10,468 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_428164535
2013-10-31 18:34:10,468 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_428164535 spawned.
2013-10-31 18:34:10,469 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000005_0/taskjvm.sh
2013-10-31 18:34:11,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data4/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:11,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data3/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:11,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data4/current/blk_-5501218942350876546
2013-10-31 18:34:11,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data3/current/blk_-3041080366967563833
2013-10-31 18:34:11,063 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_548298036330803898_1113 file build/test/data/dfs/data/data4/current/blk_548298036330803898 for deletion
2013-10-31 18:34:11,064 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_548298036330803898_1113 at file build/test/data/dfs/data/data4/current/blk_548298036330803898
2013-10-31 18:34:11,064 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data3/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:11,064 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data3/current/blk_1328316139791502870
2013-10-31 18:34:11,791 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_5720203401911213791_1133 to 127.0.0.1:37740
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5501218942350876546_1124 file build/test/data/dfs/data/data5/current/blk_-5501218942350876546 for deletion
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3041080366967563833_1110 file build/test/data/dfs/data/data5/current/blk_-3041080366967563833 for deletion
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5501218942350876546_1124 at file build/test/data/dfs/data/data5/current/blk_-5501218942350876546
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1328316139791502870_1112 file build/test/data/dfs/data/data5/current/blk_1328316139791502870 for deletion
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3041080366967563833_1110 at file build/test/data/dfs/data/data5/current/blk_-3041080366967563833
2013-10-31 18:34:11,792 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1328316139791502870_1112 at file build/test/data/dfs/data/data5/current/blk_1328316139791502870
2013-10-31 18:34:11,793 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_5720203401911213791_1133 to /127.0.0.1:37740
2013-10-31 18:34:11,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5720203401911213791_1133 src: /127.0.0.1:47157 dest: /127.0.0.1:37740
2013-10-31 18:34:11,795 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5720203401911213791_1133 src: /127.0.0.1:47157 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:34:11,798 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5720203401911213791_1133 size 238055
2013-10-31 18:34:12,188 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6248130088879987270_1132 to 127.0.0.1:54365
2013-10-31 18:34:12,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6248130088879987270_1132 src: /127.0.0.1:47442 dest: /127.0.0.1:54365
2013-10-31 18:34:12,189 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6248130088879987270_1132 to /127.0.0.1:54365
2013-10-31 18:34:12,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6248130088879987270_1132 src: /127.0.0.1:47442 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:34:12,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6248130088879987270_1132 size 238055
2013-10-31 18:34:12,309 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:12,333 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0013
2013-10-31 18:34:12,333 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0013_m_000001_0 not found in cache
2013-10-31 18:34:12,333 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0013 for user-log deletion with retainTimeStamp:1383330852333
2013-10-31 18:34:12,356 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_428164535 given task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:12,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:12,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:13,667 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_m_-137784207 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,678 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23873 with signal TERM. Exit code 0
2013-10-31 18:34:13,736 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_r_-2042360792 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,742 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23951 with signal TERM. Exit code 0
2013-10-31 18:34:13,817 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0013_m_932760728 since job job_20131031182606197_0013 is dead
2013-10-31 18:34:13,821 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group23709 with signal TERM. Exit code 0
2013-10-31 18:34:13,903 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,903 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,904 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:13,904 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_m_-137784207 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:13,907 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,907 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,907 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:13,907 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_r_-2042360792 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:13,990 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:13,990 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:13,990 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:13,992 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0013_m_932760728 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:15,774 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000005_0 0.0% setup
2013-10-31 18:34:15,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000005_0 is done.
2013-10-31 18:34:15,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000005_0 was -1
2013-10-31 18:34:15,777 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:15,779 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000005_0 0.0% setup
2013-10-31 18:34:15,781 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000005_0 is done.
2013-10-31 18:34:15,782 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000005_0 was -1
2013-10-31 18:34:15,782 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:16,258 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000005_0' has completed task_20131031182606197_0014_m_000005 successfully.
2013-10-31 18:34:16,262 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000000_0' to tip task_20131031182606197_0014_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:16,263 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000000
2013-10-31 18:34:16,264 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:16,265 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,265 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,302 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-838970058
2013-10-31 18:34:16,303 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-838970058 spawned.
2013-10-31 18:34:16,306 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000000_0/taskjvm.sh
2013-10-31 18:34:16,352 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000005_0' has completed task_20131031182606197_0015_m_000005 successfully.
2013-10-31 18:34:16,357 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000000_0' to tip task_20131031182606197_0015_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:16,358 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000000
2013-10-31 18:34:16,359 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000001_0' to tip task_20131031182606197_0015_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:16,359 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000001
2013-10-31 18:34:16,361 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000002_0' to tip task_20131031182606197_0015_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:16,362 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:16,362 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000002
2013-10-31 18:34:16,363 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:16,363 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0015_m_000003_0' to tip task_20131031182606197_0015_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:16,363 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,364 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000000_0 which needs 1 slots
2013-10-31 18:34:16,365 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0015_m_000003
2013-10-31 18:34:16,365 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,365 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0015_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,369 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:16,371 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:16,371 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,371 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,372 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000003_0 which needs 1 slots
2013-10-31 18:34:16,372 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0015_m_000003_0 which needs 1 slots
2013-10-31 18:34:16,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015/jobToken dst=null perm=null
2013-10-31 18:34:16,382 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43273, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7689919938199943373_1141, duration: 313744
2013-10-31 18:34:16,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.xml dst=null perm=null
2013-10-31 18:34:16,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43275, bytes: 27605, op: HDFS_READ, cliID: DFSClient_-83613591, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7471099473439155231_1138, duration: 394957
2013-10-31 18:34:16,394 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000001_0' to tip task_20131031182606197_0014_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:16,394 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000001
2013-10-31 18:34:16,395 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000002_0' to tip task_20131031182606197_0014_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:16,395 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000002
2013-10-31 18:34:16,397 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:16,399 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:16,399 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,399 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000001_0 which needs 1 slots
2013-10-31 18:34:16,400 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,400 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0014_m_000002_0 which needs 1 slots
2013-10-31 18:34:16,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014/jobToken dst=null perm=null
2013-10-31 18:34:16,404 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47167, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072395253391421232_1145, duration: 117706
2013-10-31 18:34:16,406 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-550848985
2013-10-31 18:34:16,407 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-550848985 spawned.
2013-10-31 18:34:16,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.xml dst=null perm=null
2013-10-31 18:34:16,408 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0015/attempt_20131031182606197_0015_m_000001_0. Attempting to reuse: jvm_20131031182606197_0015_m_428164535
2013-10-31 18:34:16,409 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000000_0/taskjvm.sh
2013-10-31 18:34:16,409 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43278, bytes: 27609, op: HDFS_READ, cliID: DFSClient_-1373575222, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3748124066677778040_1142, duration: 165108
2013-10-31 18:34:16,413 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:16,421 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:16,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.jar dst=null perm=null
2013-10-31 18:34:16,427 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43279, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-83613591, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5720203401911213791_1133, duration: 571915
2013-10-31 18:34:16,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.jar dst=null perm=null
2013-10-31 18:34:16,435 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47454, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1373575222, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6248130088879987270_1132, duration: 642597
2013-10-31 18:34:16,559 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_1010098939
2013-10-31 18:34:16,560 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_1010098939 spawned.
2013-10-31 18:34:16,560 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0014_m_-1312562418
2013-10-31 18:34:16,561 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0014_m_-1312562418 spawned.
2013-10-31 18:34:16,563 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000002_0/taskjvm.sh
2013-10-31 18:34:16,564 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0014/attempt_20131031182606197_0014_m_000001_0/taskjvm.sh
2013-10-31 18:34:16,802 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-773358262
2013-10-31 18:34:16,803 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-773358262 spawned.
2013-10-31 18:34:16,803 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0015_m_-699255952
2013-10-31 18:34:16,804 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0015_m_-699255952 spawned.
2013-10-31 18:34:16,805 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000002_0/taskjvm.sh
2013-10-31 18:34:16,805 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0015/attempt_20131031182606197_0015_m_000003_0/taskjvm.sh
2013-10-31 18:34:16,826 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_428164535 given task: attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:16,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=null
2013-10-31 18:34:16,927 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47173, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 166608
2013-10-31 18:34:16,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:16,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:17,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:17,006 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 186 raw values into 1 aggregated values, total 21
2013-10-31 18:34:17,167 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47458, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 226045
2013-10-31 18:34:17,171 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001. blk_7675524486983705989_1146
2013-10-31 18:34:17,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:43285 dest: /127.0.0.1:59471
2013-10-31 18:34:17,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:47177 dest: /127.0.0.1:37740
2013-10-31 18:34:17,191 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7675524486983705989_1146 src: /127.0.0.1:50090 dest: /127.0.0.1:34578
2013-10-31 18:34:17,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50090, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7675524486983705989_1146, duration: 1370663
2013-10-31 18:34:17,193 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47177, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7675524486983705989_1146, duration: 1740534
2013-10-31 18:34:17,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,194 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,194 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43285, dest: /127.0.0.1:59471, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0015_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7675524486983705989_1146, duration: 2188993
2013-10-31 18:34:17,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7675524486983705989_1146 terminating
2013-10-31 18:34:17,194 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,196 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:17,196 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:17,198 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7675524486983705989_1146 size 134
2013-10-31 18:34:17,252 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:17,253 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 0.0%
2013-10-31 18:34:17,319 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-838970058 given task: attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:17,376 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_4102379777415512644_1030
2013-10-31 18:34:17,579 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-550848985 given task: attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:17,755 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-1312562418 given task: attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:17,766 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_1010098939 given task: attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:17,809 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-773358262 given task: attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:17,824 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-699255952 given task: attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:17,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=null
2013-10-31 18:34:17,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50097, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 205622
2013-10-31 18:34:17,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:17,896 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47469, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 137952
2013-10-31 18:34:17,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=null
2013-10-31 18:34:18,123 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50100, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6521390248325677253_1135, duration: 184451
2013-10-31 18:34:18,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:18,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50101, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 126628
2013-10-31 18:34:18,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,306 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000. blk_-4210927453857164432_1148
2013-10-31 18:34:18,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=null
2013-10-31 18:34:18,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:47193 dest: /127.0.0.1:37740
2013-10-31 18:34:18,332 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:43303 dest: /127.0.0.1:59471
2013-10-31 18:34:18,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4210927453857164432_1148 src: /127.0.0.1:50107 dest: /127.0.0.1:34578
2013-10-31 18:34:18,335 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50107, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4210927453857164432_1148, duration: 1553808
2013-10-31 18:34:18,336 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47479, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6443718356478161979_1135, duration: 166486
2013-10-31 18:34:18,336 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43303, dest: /127.0.0.1:59471, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4210927453857164432_1148, duration: 1580742
2013-10-31 18:34:18,336 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47193, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4210927453857164432_1148, duration: 2191213
2013-10-31 18:34:18,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4210927453857164432_1148 terminating
2013-10-31 18:34:18,339 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,339 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,340 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4210927453857164432_1148 size 181
2013-10-31 18:34:18,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=null
2013-10-31 18:34:18,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=null
2013-10-31 18:34:18,351 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47197, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6521390248325677253_1135, duration: 159878
2013-10-31 18:34:18,352 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47198, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6443718356478161979_1135, duration: 149826
2013-10-31 18:34:18,352 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:18,353 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:18,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:18,376 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47200, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 170132
2013-10-31 18:34:18,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:18,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:18,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47484, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 152737
2013-10-31 18:34:18,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,398 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,398 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000000_0 0.0%
2013-10-31 18:34:18,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015/job.split dst=null perm=null
2013-10-31 18:34:18,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43311, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6521390248325677253_1135, duration: 129490
2013-10-31 18:34:18,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:18,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47486, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0015_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 176550
2013-10-31 18:34:18,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:18,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:18,555 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:18,555 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:18,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50116, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 191427
2013-10-31 18:34:18,575 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:18,575 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:18,582 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:18,582 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:18,604 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,604 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000002_0 0.0%
2013-10-31 18:34:18,621 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,622 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000002_0 0.0%
2013-10-31 18:34:18,627 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,627 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000001_0 0.0%
2013-10-31 18:34:18,664 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:18,665 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:18,709 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0015_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:18,710 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000003_0 0.0%
2013-10-31 18:34:18,739 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:18,739 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:19,267 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0014_m_000003_0' to tip task_20131031182606197_0014_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:19,268 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0014_m_000003
2013-10-31 18:34:19,270 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:19,270 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000003_0 which needs 1 slots
2013-10-31 18:34:19,271 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0014_m_000003_0 which needs 1 slots
2013-10-31 18:34:19,306 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0014/attempt_20131031182606197_0014_m_000003_0. Attempting to reuse: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:19,329 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,364 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000000_0
2013-10-31 18:34:19,364 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000001_0
2013-10-31 18:34:19,370 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000002_0
2013-10-31 18:34:19,370 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0015_m_000003_0
2013-10-31 18:34:19,399 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000001_0
2013-10-31 18:34:19,399 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000002_0
2013-10-31 18:34:19,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0 dst=null perm=null
2013-10-31 18:34:19,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014/job.split dst=null perm=null
2013-10-31 18:34:19,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50118, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6443718356478161979_1135, duration: 174792
2013-10-31 18:34:19,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:19,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50119, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 379349
2013-10-31 18:34:19,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0 dst=null perm=null
2013-10-31 18:34:19,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0 dst=null perm=null
2013-10-31 18:34:19,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0 dst=null perm=null
2013-10-31 18:34:19,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000001_0 dst=null perm=null
2013-10-31 18:34:19,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000002_0 dst=null perm=null
2013-10-31 18:34:19,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000002_0 dst=null perm=null
2013-10-31 18:34:19,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000000_0 dst=null perm=null
2013-10-31 18:34:19,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0 dst=null perm=null
2013-10-31 18:34:19,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:19,722 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:19,722 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 0.0%
2013-10-31 18:34:19,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:19,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000003_0 dst=null perm=null
2013-10-31 18:34:19,856 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003. blk_9191423163742438852_1153
2013-10-31 18:34:19,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:50120 dest: /127.0.0.1:34578
2013-10-31 18:34:19,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:47209 dest: /127.0.0.1:37740
2013-10-31 18:34:19,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9191423163742438852_1153 src: /127.0.0.1:47493 dest: /127.0.0.1:54365
2013-10-31 18:34:19,877 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47493, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 1446386
2013-10-31 18:34:19,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,878 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47209, dest: /127.0.0.1:37740, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9191423163742438852_1153, duration: 1905945
2013-10-31 18:34:19,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50120, dest: /127.0.0.1:34578, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0014_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9191423163742438852_1153, duration: 2347985
2013-10-31 18:34:19,879 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9191423163742438852_1153 terminating
2013-10-31 18:34:19,879 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,881 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,881 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:19,883 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9191423163742438852_1153 size 180
2013-10-31 18:34:19,983 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0014_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:19,984 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 0.0%
2013-10-31 18:34:20,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0 dst=null perm=null
2013-10-31 18:34:20,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:20,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:20,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary/_attempt_20131031182606197_0015_m_000001_0 dst=null perm=null
2013-10-31 18:34:21,051 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:21,052 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000000_0 is done.
2013-10-31 18:34:21,053 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000000_0 was -1
2013-10-31 18:34:21,053 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,261 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:21,263 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000002_0 is done.
2013-10-31 18:34:21,263 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000002_0 was -1
2013-10-31 18:34:21,264 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,265 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:21,265 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0014_m_000005_0
2013-10-31 18:34:21,266 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000005_0 not found in cache
2013-10-31 18:34:21,268 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:21,269 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:21,270 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000001_0 is done.
2013-10-31 18:34:21,270 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000001_0 was -1
2013-10-31 18:34:21,270 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:21,271 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000002_0 is done.
2013-10-31 18:34:21,272 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000002_0 was -1
2013-10-31 18:34:21,272 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:21,364 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:21,364 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0015_m_000005_0
2013-10-31 18:34:21,364 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000005_0 not found in cache
2013-10-31 18:34:21,367 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:21,369 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000003_0 is done.
2013-10-31 18:34:21,369 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000003_0 was -1
2013-10-31 18:34:21,369 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:22,275 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000000_0
2013-10-31 18:34:22,275 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0014_m_000003_0
2013-10-31 18:34:22,366 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000000_0' has completed task_20131031182606197_0015_m_000000 successfully.
2013-10-31 18:34:22,372 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000002_0' has completed task_20131031182606197_0015_m_000002 successfully.
2013-10-31 18:34:22,372 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000003_0' has completed task_20131031182606197_0015_m_000003 successfully.
2013-10-31 18:34:22,400 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000001_0' has completed task_20131031182606197_0014_m_000001 successfully.
2013-10-31 18:34:22,401 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000002_0' has completed task_20131031182606197_0014_m_000002 successfully.
2013-10-31 18:34:22,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0 dst=null perm=null
2013-10-31 18:34:22,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:22,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:22,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000000_0 dst=null perm=null
2013-10-31 18:34:22,942 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:22,947 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:22,949 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000001_0 is done.
2013-10-31 18:34:22,949 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000001_0 was -1
2013-10-31 18:34:22,950 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:22,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0 dst=null perm=null
2013-10-31 18:34:23,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:23,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:23,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary/_attempt_20131031182606197_0014_m_000003_0 dst=null perm=null
2013-10-31 18:34:23,824 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:23,826 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:23,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000000_0 is done.
2013-10-31 18:34:23,827 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000000_0 was -1
2013-10-31 18:34:23,827 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:34:25,279 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000000_0' has completed task_20131031182606197_0014_m_000000 successfully.
2013-10-31 18:34:25,369 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000001_0' has completed task_20131031182606197_0015_m_000001 successfully.
2013-10-31 18:34:25,373 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0015_m_000004_0' to tip task_20131031182606197_0015_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:25,375 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0015_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:25,376 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0015_m_000004_0 which needs 1 slots
2013-10-31 18:34:25,376 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0015_m_000004_0 which needs 1 slots
2013-10-31 18:34:25,409 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0015/attempt_20131031182606197_0015_m_000004_0. Attempting to reuse: jvm_20131031182606197_0015_m_-550848985
2013-10-31 18:34:25,466 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:25,468 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:25,469 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000003_0 is done.
2013-10-31 18:34:25,470 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000003_0 was -1
2013-10-31 18:34:25,470 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:26,118 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0015_m_-550848985 given task: attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,225 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000004_0 0.0%
2013-10-31 18:34:26,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary dst=null perm=null
2013-10-31 18:34:26,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:26,256 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS from client DFSClient_attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,256 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0015_m_000004_0
2013-10-31 18:34:26,265 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,265 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,265 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,265 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5720203401911213791 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,266 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,266 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,266 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,266 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6521390248325677253 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,267 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,267 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,267 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6288635088291707302 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:26,267 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:26,267 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:26,268 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7471099473439155231 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:26,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0015 dst=null perm=null
2013-10-31 18:34:28,286 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000003_0' has completed task_20131031182606197_0014_m_000003 successfully.
2013-10-31 18:34:28,328 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0014_m_000004_0' to tip task_20131031182606197_0014_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:28,330 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0014_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:28,331 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0014_m_000004_0 which needs 1 slots
2013-10-31 18:34:28,331 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0014_m_000004_0 which needs 1 slots
2013-10-31 18:34:28,399 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0014/attempt_20131031182606197_0014_m_000004_0. Attempting to reuse: jvm_20131031182606197_0014_m_-251095346
2013-10-31 18:34:28,432 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-7471099473439155231_1138 blk_6521390248325677253_1135 blk_5720203401911213791_1133
2013-10-31 18:34:28,433 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-7471099473439155231_1138 blk_6288635088291707302_1137 blk_6521390248325677253_1135 blk_5720203401911213791_1133
2013-10-31 18:34:28,998 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0014_m_-251095346 given task: attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data4/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:29,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data4/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:29,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data4/current/blk_-7471099473439155231
2013-10-31 18:34:29,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data4/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:29,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data4/current/blk_5720203401911213791
2013-10-31 18:34:29,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data4/current/blk_6521390248325677253
2013-10-31 18:34:29,104 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000004_0 0.0%
2013-10-31 18:34:29,106 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 811 Total time for transactions(ms): 21Number of transactions batched in Syncs: 69 Number of syncs: 557 SyncTimes(ms): 57590 12652
2013-10-31 18:34:29,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary dst=null perm=null
2013-10-31 18:34:29,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:29,116 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS from client DFSClient_attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,116 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0014_m_000004_0
2013-10-31 18:34:29,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,123 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6248130088879987270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,124 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,124 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,124 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,124 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6443718356478161979 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,124 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,125 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:29,125 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6337612719236416595 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,125 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:29,125 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:29,125 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3748124066677778040 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:29,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0014 dst=null perm=null
2013-10-31 18:34:29,194 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0015_m_000004_0 0.0% cleanup
2013-10-31 18:34:29,195 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0015_m_000004_0 is done.
2013-10-31 18:34:29,195 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0015_m_000004_0 was -1
2013-10-31 18:34:29,195 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:29,798 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data5/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:29,798 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data5/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:29,798 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data5/current/blk_-7471099473439155231
2013-10-31 18:34:29,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data6/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:29,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data5/current/blk_5720203401911213791
2013-10-31 18:34:29,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data5/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:29,799 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data6/current/blk_6288635088291707302
2013-10-31 18:34:29,800 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data5/current/blk_6521390248325677253
2013-10-31 18:34:31,381 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0015_m_000004_0' has completed task_20131031182606197_0015_m_000004 successfully.
2013-10-31 18:34:31,382 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0015 has completed successfully.
2013-10-31 18:34:31,383 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0015,submitTime=1383244448383,launchTime=1383244448503,firstMapTaskLaunchTime=1383244456357,firstJobSetupTaskLaunchTime=1383244450338,firstJobCleanupTaskLaunchTime=1383244465372,finishTime=1383244471382,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DD45149DA44B791799BCE9F119D10/A40DB423CB6E4633A5191EA4B939F931] left+right/(2/2) ...eldedpipesplatform/split1
2013-10-31 18:34:31,391 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633. blk_4749128138481676338_1155
2013-10-31 18:34:31,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:47497 dest: /127.0.0.1:54365
2013-10-31 18:34:31,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:43324 dest: /127.0.0.1:59471
2013-10-31 18:34:31,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4749128138481676338_1155 src: /127.0.0.1:50128 dest: /127.0.0.1:34578
2013-10-31 18:34:31,405 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50128, dest: /127.0.0.1:34578, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4749128138481676338_1155, duration: 4903043
2013-10-31 18:34:31,405 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,406 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43324, dest: /127.0.0.1:59471, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4749128138481676338_1155, duration: 4325288
2013-10-31 18:34:31,406 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,407 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47497, dest: /127.0.0.1:54365, bytes: 21727, op: HDFS_WRITE, cliID: DFSClient_1053356637, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4749128138481676338_1155, duration: 4598147
2013-10-31 18:34:31,408 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4749128138481676338_1155 terminating
2013-10-31 18:34:31,412 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4749128138481676338_1155 size 21727
2013-10-31 18:34:31,412 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 from client DFSClient_1053356637
2013-10-31 18:34:31,413 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_logs/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 is closed by DFSClient_1053356637
2013-10-31 18:34:31,419 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0015_1383244448383_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FA40DB423CB6E4633 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:31,420 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000000_0'
2013-10-31 18:34:31,420 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000001_0'
2013-10-31 18:34:31,420 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000004_0'
2013-10-31 18:34:31,421 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000005_0'
2013-10-31 18:34:31,422 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:31,423 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:31,423 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:31,423 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0015 being deleted.
2013-10-31 18:34:31,423 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7689919938199943373 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:31,423 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000002_0'
2013-10-31 18:34:31,424 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0015_m_000003_0'
2013-10-31 18:34:31,426 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0015_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:31,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0015 dst=null perm=null
2013-10-31 18:34:31,433 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_6337612719236416595_1137 blk_6288635088291707302_1137 blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_6521390248325677253_1135 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135 blk_5720203401911213791_1133
2013-10-31 18:34:31,434 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_6337612719236416595_1137 blk_-7471099473439155231_1138 blk_6288635088291707302_1137 blk_6248130088879987270_1132 blk_6521390248325677253_1135 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135 blk_5720203401911213791_1133
2013-10-31 18:34:32,078 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0014_m_000004_0 0.0% cleanup
2013-10-31 18:34:32,079 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0014_m_000004_0 is done.
2013-10-31 18:34:32,079 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0014_m_000004_0 was -1
2013-10-31 18:34:32,080 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:33,196 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data1/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:33,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data2/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:33,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data1/current/blk_-7689919938199943373
2013-10-31 18:34:33,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data2/current/blk_-6443718356478161979
2013-10-31 18:34:33,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data2/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:33,198 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data1/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:33,198 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data2/current/blk_-3748124066677778040
2013-10-31 18:34:33,198 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data2/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:33,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data1/current/blk_5720203401911213791
2013-10-31 18:34:33,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data1/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:33,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data2/current/blk_6248130088879987270
2013-10-31 18:34:33,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data1/current/blk_6288635088291707302
2013-10-31 18:34:33,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data2/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:33,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data1/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:33,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data2/current/blk_6337612719236416595
2013-10-31 18:34:33,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data1/current/blk_6521390248325677253
2013-10-31 18:34:33,269 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data8/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:33,269 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7471099473439155231_1138 file build/test/data/dfs/data/data8/current/blk_-7471099473439155231 for deletion
2013-10-31 18:34:33,269 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data8/current/blk_-7689919938199943373
2013-10-31 18:34:33,269 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data8/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:33,270 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7471099473439155231_1138 at file build/test/data/dfs/data/data8/current/blk_-7471099473439155231
2013-10-31 18:34:33,270 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5720203401911213791_1133 file build/test/data/dfs/data/data7/current/blk_5720203401911213791 for deletion
2013-10-31 18:34:33,270 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data8/current/blk_-6443718356478161979
2013-10-31 18:34:33,270 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data7/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:33,271 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5720203401911213791_1133 at file build/test/data/dfs/data/data7/current/blk_5720203401911213791
2013-10-31 18:34:33,271 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6288635088291707302_1137 file build/test/data/dfs/data/data7/current/blk_6288635088291707302 for deletion
2013-10-31 18:34:33,271 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data7/current/blk_6248130088879987270
2013-10-31 18:34:33,271 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data8/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:33,271 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6288635088291707302_1137 at file build/test/data/dfs/data/data7/current/blk_6288635088291707302
2013-10-31 18:34:33,272 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6521390248325677253_1135 file build/test/data/dfs/data/data7/current/blk_6521390248325677253 for deletion
2013-10-31 18:34:33,272 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data8/current/blk_6337612719236416595
2013-10-31 18:34:33,272 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6521390248325677253_1135 at file build/test/data/dfs/data/data7/current/blk_6521390248325677253
2013-10-31 18:34:34,338 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0014_m_000004_0' has completed task_20131031182606197_0014_m_000004 successfully.
2013-10-31 18:34:34,339 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0014 has completed successfully.
2013-10-31 18:34:34,340 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0014,submitTime=1383244448954,launchTime=1383244449067,firstMapTaskLaunchTime=1383244456261,firstJobSetupTaskLaunchTime=1383244450248,firstJobCleanupTaskLaunchTime=1383244468328,finishTime=1383244474339,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=32,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[171DD45149DA44B791799BCE9F119D10/F2CCF5EB3F8E47E9901B36D1A1BB76A4] left+right/(1/2) ...eldedpipesplatform/split2
2013-10-31 18:34:34,346 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9. blk_-779614672427365938_1155
2013-10-31 18:34:34,348 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:47509 dest: /127.0.0.1:54365
2013-10-31 18:34:34,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:50139 dest: /127.0.0.1:34578
2013-10-31 18:34:34,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-779614672427365938_1155 src: /127.0.0.1:43337 dest: /127.0.0.1:59471
2013-10-31 18:34:34,357 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43337, dest: /127.0.0.1:59471, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-779614672427365938_1155, duration: 300908
2013-10-31 18:34:34,358 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,358 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50139, dest: /127.0.0.1:34578, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-779614672427365938_1155, duration: 1112987
2013-10-31 18:34:34,359 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,359 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47509, dest: /127.0.0.1:54365, bytes: 22049, op: HDFS_WRITE, cliID: DFSClient_-273342706, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-779614672427365938_1155, duration: 2069111
2013-10-31 18:34:34,359 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-779614672427365938_1155 terminating
2013-10-31 18:34:34,362 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,364 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 from client DFSClient_-273342706
2013-10-31 18:34:34,364 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_logs/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 is closed by DFSClient_-273342706
2013-10-31 18:34:34,365 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,365 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-779614672427365938_1155 size 22049
2013-10-31 18:34:34,372 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0014_1383244448954_hadoop_%5B171DD45149DA44B791799BCE9F119D10%2FF2CCF5EB3F8E47E9 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:34,372 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000000_0'
2013-10-31 18:34:34,373 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000003_0'
2013-10-31 18:34:34,373 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:34,373 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000004_0'
2013-10-31 18:34:34,373 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:34,373 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000005_0'
2013-10-31 18:34:34,374 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072395253391421232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:34,377 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0014_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:34,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0014 dst=null perm=null
2013-10-31 18:34:34,382 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/_temporary
2013-10-31 18:34:34,384 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/_temporary
2013-10-31 18:34:34,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=null
2013-10-31 18:34:34,405 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:34,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000 dst=null perm=null
2013-10-31 18:34:34,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001 dst=null perm=null
2013-10-31 18:34:34,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002 dst=null perm=null
2013-10-31 18:34:34,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003 dst=null perm=null
2013-10-31 18:34:34,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000 dst=null perm=null
2013-10-31 18:34:34,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001 dst=null perm=null
2013-10-31 18:34:34,415 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43338, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7675524486983705989_1146, duration: 300405
2013-10-31 18:34:34,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002 dst=null perm=null
2013-10-31 18:34:34,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003 dst=null perm=null
2013-10-31 18:34:34,426 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000001_0'
2013-10-31 18:34:34,426 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0014_m_000002_0'
2013-10-31 18:34:34,434 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-9072395253391421232_1145 blk_6337612719236416595_1137 blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_-6443718356478161979_1135
2013-10-31 18:34:34,435 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-9072395253391421232_1145
2013-10-31 18:34:34,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=null
2013-10-31 18:34:34,437 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:34,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000 dst=null perm=null
2013-10-31 18:34:34,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001 dst=null perm=null
2013-10-31 18:34:34,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002 dst=null perm=null
2013-10-31 18:34:34,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003 dst=null perm=null
2013-10-31 18:34:34,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000 dst=null perm=null
2013-10-31 18:34:34,444 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43339, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4210927453857164432_1148, duration: 281641
2013-10-31 18:34:34,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001 dst=null perm=null
2013-10-31 18:34:34,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002 dst=null perm=null
2013-10-31 18:34:34,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003 dst=null perm=null
2013-10-31 18:34:34,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47514, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 142436
2013-10-31 18:34:34,448 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/split2
2013-10-31 18:34:34,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2 dst=null perm=null
2013-10-31 18:34:34,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00000 dst=null perm=null
2013-10-31 18:34:34,454 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50144, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4210927453857164432_1148, duration: 118957
2013-10-31 18:34:34,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00001 dst=null perm=null
2013-10-31 18:34:34,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00002 dst=null perm=null
2013-10-31 18:34:34,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split2/part-00003 dst=null perm=null
2013-10-31 18:34:34,461 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47516, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9191423163742438852_1153, duration: 109104
2013-10-31 18:34:34,461 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/split1
2013-10-31 18:34:34,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1 dst=null perm=null
2013-10-31 18:34:34,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00000 dst=null perm=null
2013-10-31 18:34:34,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00001 dst=null perm=null
2013-10-31 18:34:34,472 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47234, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7675524486983705989_1146, duration: 269218
2013-10-31 18:34:34,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00002 dst=null perm=null
2013-10-31 18:34:34,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/split1/part-00003 dst=null perm=null
2013-10-31 18:34:34,496 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:34:34,497 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:34:34,516 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting
2013-10-31 18:34:34,517 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:34:34,517 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged"]
2013-10-31 18:34:34,518 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] parallel execution is enabled: true
2013-10-31 18:34:34,518 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting jobs: 2
2013-10-31 18:34:34,518 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] allocating threads: 2
2013-10-31 18:34:34,519 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (1/2)
2013-10-31 18:34:34,522 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:34,522 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:34:34,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:34,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:34:34,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:34,538 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar. blk_-6758522467386195759_1156
2013-10-31 18:34:34,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:50147 dest: /127.0.0.1:34578
2013-10-31 18:34:34,541 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:47236 dest: /127.0.0.1:37740
2013-10-31 18:34:34,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:47520 dest: /127.0.0.1:54365
2013-10-31 18:34:34,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47520, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6758522467386195759_1156, duration: 3744536
2013-10-31 18:34:34,551 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,551 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47236, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 4639001
2013-10-31 18:34:34,552 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,552 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50147, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6758522467386195759_1156, duration: 5617585
2013-10-31 18:34:34,553 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6758522467386195759_1156 terminating
2013-10-31 18:34:34,554 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,555 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:34,555 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:34,556 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,557 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:34,560 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar. New replication is 10
2013-10-31 18:34:34,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=null
2013-10-31 18:34:34,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,000 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:35,005 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:34:35,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:35,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,021 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split. New replication is 10
2013-10-31 18:34:35,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=null
2013-10-31 18:34:35,028 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split. blk_6399496362179302068_1157
2013-10-31 18:34:35,030 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:43347 dest: /127.0.0.1:59471
2013-10-31 18:34:35,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:47522 dest: /127.0.0.1:54365
2013-10-31 18:34:35,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:50152 dest: /127.0.0.1:34578
2013-10-31 18:34:35,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6399496362179302068_1157 src: /127.0.0.1:47241 dest: /127.0.0.1:37740
2013-10-31 18:34:35,038 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47241, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 121326
2013-10-31 18:34:35,039 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,039 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,039 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50152, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6399496362179302068_1157, duration: 1017074
2013-10-31 18:34:35,040 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,040 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47522, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 2180010
2013-10-31 18:34:35,041 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,041 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43347, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6399496362179302068_1157, duration: 3015493
2013-10-31 18:34:35,041 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6399496362179302068_1157 terminating
2013-10-31 18:34:35,043 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,043 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split from client DFSClient_-1596270109
2013-10-31 18:34:35,044 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:35,044 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6399496362179302068_1157 size 1403
2013-10-31 18:34:35,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,066 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo. blk_-3213097698103852867_1158
2013-10-31 18:34:35,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:43351 dest: /127.0.0.1:59471
2013-10-31 18:34:35,069 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:47526 dest: /127.0.0.1:54365
2013-10-31 18:34:35,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data4/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:35,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data3/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:35,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data4/current/blk_-9072395253391421232
2013-10-31 18:34:35,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data3/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:35,071 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data3/current/blk_-6443718356478161979
2013-10-31 18:34:35,072 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data3/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:35,072 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data3/current/blk_-3748124066677778040
2013-10-31 18:34:35,072 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6337612719236416595_1137 file build/test/data/dfs/data/data3/current/blk_6337612719236416595 for deletion
2013-10-31 18:34:35,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3213097698103852867_1158 src: /127.0.0.1:50156 dest: /127.0.0.1:34578
2013-10-31 18:34:35,073 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data3/current/blk_6248130088879987270
2013-10-31 18:34:35,073 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6337612719236416595_1137 at file build/test/data/dfs/data/data3/current/blk_6337612719236416595
2013-10-31 18:34:35,076 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50156, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3213097698103852867_1158, duration: 63430
2013-10-31 18:34:35,076 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,077 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47526, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3213097698103852867_1158, duration: 852257
2013-10-31 18:34:35,077 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,077 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,077 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43351, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3213097698103852867_1158, duration: 1718046
2013-10-31 18:34:35,078 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3213097698103852867_1158 terminating
2013-10-31 18:34:35,082 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,082 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:35,083 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:35,083 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3213097698103852867_1158 size 156
2013-10-31 18:34:35,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,108 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml. blk_7100172975871123190_1159
2013-10-31 18:34:35,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:47245 dest: /127.0.0.1:37740
2013-10-31 18:34:35,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:47529 dest: /127.0.0.1:54365
2013-10-31 18:34:35,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7100172975871123190_1159 src: /127.0.0.1:50159 dest: /127.0.0.1:34578
2013-10-31 18:34:35,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50159, dest: /127.0.0.1:34578, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 70132
2013-10-31 18:34:35,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,117 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47529, dest: /127.0.0.1:54365, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7100172975871123190_1159, duration: 892568
2013-10-31 18:34:35,117 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,118 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47245, dest: /127.0.0.1:37740, bytes: 27445, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7100172975871123190_1159, duration: 1749168
2013-10-31 18:34:35,118 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7100172975871123190_1159 terminating
2013-10-31 18:34:35,121 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,121 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:35,122 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:35,122 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,122 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7100172975871123190_1159 size 27445
2013-10-31 18:34:35,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=null
2013-10-31 18:34:35,137 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50161, bytes: 27661, op: HDFS_READ, cliID: DFSClient_2100615146, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 403775
2013-10-31 18:34:35,156 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0016: nMaps=4 nReduces=0 max=-1
2013-10-31 18:34:35,157 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0016 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:35,157 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0016
2013-10-31 18:34:35,157 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0016 RESULT=SUCCESS
2013-10-31 18:34:35,157 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0016
2013-10-31 18:34:35,159 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0016
2013-10-31 18:34:35,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,178 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml. blk_-6789407230370558946_1161
2013-10-31 18:34:35,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:43359 dest: /127.0.0.1:59471
2013-10-31 18:34:35,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:47534 dest: /127.0.0.1:54365
2013-10-31 18:34:35,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6789407230370558946_1161 src: /127.0.0.1:47252 dest: /127.0.0.1:37740
2013-10-31 18:34:35,187 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47252, dest: /127.0.0.1:37740, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6789407230370558946_1161, duration: 323816
2013-10-31 18:34:35,187 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,187 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47534, dest: /127.0.0.1:54365, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6789407230370558946_1161, duration: 1179244
2013-10-31 18:34:35,188 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,188 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43359, dest: /127.0.0.1:59471, bytes: 27510, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6789407230370558946_1161, duration: 2140226
2013-10-31 18:34:35,189 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6789407230370558946_1161 terminating
2013-10-31 18:34:35,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,193 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,193 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6789407230370558946_1161 size 27510
2013-10-31 18:34:35,593 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml from client DFSClient_2100615146
2013-10-31 18:34:35,593 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_conf.xml is closed by DFSClient_2100615146
2013-10-31 18:34:35,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:35,605 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken. blk_3357374393869421348_1162
2013-10-31 18:34:35,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:43362 dest: /127.0.0.1:59471
2013-10-31 18:34:35,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:50166 dest: /127.0.0.1:34578
2013-10-31 18:34:35,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3357374393869421348_1162 src: /127.0.0.1:47538 dest: /127.0.0.1:54365
2013-10-31 18:34:35,613 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47538, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3357374393869421348_1162, duration: 72618
2013-10-31 18:34:35,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50166, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3357374393869421348_1162, duration: 844008
2013-10-31 18:34:35,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,615 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,615 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43362, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 1735861
2013-10-31 18:34:35,616 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,616 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3357374393869421348_1162 terminating
2013-10-31 18:34:35,618 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3357374393869421348_1162 size 116
2013-10-31 18:34:35,618 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:35,619 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:35,623 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken
2013-10-31 18:34:35,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.splitmetainfo dst=null perm=null
2013-10-31 18:34:35,627 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50168, bytes: 160, op: HDFS_READ, cliID: DFSClient_2100615146, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3213097698103852867_1158, duration: 279127
2013-10-31 18:34:35,628 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0016 = 1449. Number of splits = 4
2013-10-31 18:34:35,629 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,629 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,630 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,631 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0016_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:35,632 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0016 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:35,632 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0016 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:34:36,269 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data8/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:36,270 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data8/current/blk_-9072395253391421232
2013-10-31 18:34:36,423 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:36,423 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000000_0 not found in cache
2013-10-31 18:34:36,423 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000004_0 not found in cache
2013-10-31 18:34:36,423 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000001_0 not found in cache
2013-10-31 18:34:36,424 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383330876424
2013-10-31 18:34:36,424 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:36,425 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0014 being deleted.
2013-10-31 18:34:36,425 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:36,425 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000003_0 not found in cache
2013-10-31 18:34:36,426 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0015_m_000002_0 not found in cache
2013-10-31 18:34:36,426 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0015 for user-log deletion with retainTimeStamp:1383330876426
2013-10-31 18:34:36,426 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:36,427 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0014 being deleted.
2013-10-31 18:34:36,828 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-773358262 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,839 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24614 with signal TERM. Exit code 0
2013-10-31 18:34:36,948 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-699255952 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,955 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24613 with signal TERM. Exit code 0
2013-10-31 18:34:36,992 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_428164535 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:36,997 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24292 with signal TERM. Exit code 0
2013-10-31 18:34:37,052 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,052 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,052 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:37,053 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-773358262 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:37,155 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,155 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,155 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:37,155 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_428164535 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:37,156 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,156 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,156 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:37,156 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-699255952 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:37,225 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0015_m_-550848985 since job job_20131031182606197_0015 is dead
2013-10-31 18:34:37,235 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24509 with signal TERM. Exit code 0
2013-10-31 18:34:37,379 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0016_m_000005_0' to tip task_20131031182606197_0016_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:37,385 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3135295757712174631_1031
2013-10-31 18:34:37,388 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:34:37,389 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000005_0 which needs 1 slots
2013-10-31 18:34:37,389 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000005_0 which needs 1 slots
2013-10-31 18:34:37,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken dst=null perm=null
2013-10-31 18:34:37,398 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50169, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3357374393869421348_1162, duration: 287552
2013-10-31 18:34:37,402 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,402 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,402 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:37,402 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0015_m_-550848985 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:34:37,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=null
2013-10-31 18:34:37,407 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47259, bytes: 27661, op: HDFS_READ, cliID: DFSClient_-1387558199, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7100172975871123190_1159, duration: 202167
2013-10-31 18:34:37,434 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:37,435 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-6758522467386195759_1156 to datanode(s) 127.0.0.1:59471
2013-10-31 18:34:37,436 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-9072395253391421232_1145
2013-10-31 18:34:37,436 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_6248130088879987270_1132 blk_-3748124066677778040_1142 blk_-7689919938199943373_1141 blk_-6443718356478161979_1135
2013-10-31 18:34:37,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=null
2013-10-31 18:34:37,468 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47543, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1387558199, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6758522467386195759_1156, duration: 1680870
2013-10-31 18:34:37,563 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0014_m_-838970058
2013-10-31 18:34:37,570 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24461 with signal TERM. Exit code 0
2013-10-31 18:34:37,570 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_386164469
2013-10-31 18:34:37,571 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_386164469 spawned.
2013-10-31 18:34:37,573 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000005_0/taskjvm.sh
2013-10-31 18:34:37,695 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:37,695 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:37,695 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:37,696 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-838970058 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:38,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7689919938199943373_1141 file build/test/data/dfs/data/data5/current/blk_-7689919938199943373 for deletion
2013-10-31 18:34:38,801 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6443718356478161979_1135 file build/test/data/dfs/data/data6/current/blk_-6443718356478161979 for deletion
2013-10-31 18:34:38,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3748124066677778040_1142 file build/test/data/dfs/data/data6/current/blk_-3748124066677778040 for deletion
2013-10-31 18:34:38,802 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6248130088879987270_1132 file build/test/data/dfs/data/data6/current/blk_6248130088879987270 for deletion
2013-10-31 18:34:38,841 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6443718356478161979_1135 at file build/test/data/dfs/data/data6/current/blk_-6443718356478161979
2013-10-31 18:34:38,841 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7689919938199943373_1141 at file build/test/data/dfs/data/data5/current/blk_-7689919938199943373
2013-10-31 18:34:38,842 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3748124066677778040_1142 at file build/test/data/dfs/data/data6/current/blk_-3748124066677778040
2013-10-31 18:34:38,842 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6248130088879987270_1132 at file build/test/data/dfs/data/data6/current/blk_6248130088879987270
2013-10-31 18:34:39,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072395253391421232_1145 file build/test/data/dfs/data/data2/current/blk_-9072395253391421232 for deletion
2013-10-31 18:34:39,197 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072395253391421232_1145 at file build/test/data/dfs/data/data2/current/blk_-9072395253391421232
2013-10-31 18:34:39,270 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-6758522467386195759_1156 to 127.0.0.1:59471
2013-10-31 18:34:39,271 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6758522467386195759_1156 src: /127.0.0.1:43370 dest: /127.0.0.1:59471
2013-10-31 18:34:39,271 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-6758522467386195759_1156 to /127.0.0.1:59471
2013-10-31 18:34:39,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-6758522467386195759_1156 src: /127.0.0.1:43370 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:34:39,274 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6758522467386195759_1156 size 238055
2013-10-31 18:34:39,374 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:39,375 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000004_0 not found in cache
2013-10-31 18:34:39,375 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000003_0 not found in cache
2013-10-31 18:34:39,375 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000000_0 not found in cache
2013-10-31 18:34:39,375 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383330879375
2013-10-31 18:34:39,375 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0015
2013-10-31 18:34:39,376 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0015 being deleted.
2013-10-31 18:34:39,427 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0014
2013-10-31 18:34:39,427 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000002_0 not found in cache
2013-10-31 18:34:39,427 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0014_m_000001_0 not found in cache
2013-10-31 18:34:39,427 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0014 for user-log deletion with retainTimeStamp:1383330879427
2013-10-31 18:34:39,650 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_386164469 given task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:39,831 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_1010098939 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:39,836 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24554 with signal TERM. Exit code 0
2013-10-31 18:34:39,843 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_-1312562418 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:39,847 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24553 with signal TERM. Exit code 0
2013-10-31 18:34:40,043 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,044 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,044 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:40,044 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-1312562418 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:40,052 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,052 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,052 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:40,053 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_1010098939 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:34:40,111 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0014_m_-251095346 since job job_20131031182606197_0014 is dead
2013-10-31 18:34:40,120 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group24262 with signal TERM. Exit code 0
2013-10-31 18:34:40,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:40,282 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:34:40,282 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:34:40,283 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:34:40,283 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0014_m_-251095346 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:34:43,121 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000005_0 0.0% setup
2013-10-31 18:34:43,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000005_0 is done.
2013-10-31 18:34:43,125 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000005_0 was -1
2013-10-31 18:34:43,125 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:43,393 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000005_0' has completed task_20131031182606197_0016_m_000005 successfully.
2013-10-31 18:34:43,396 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000000_0' to tip task_20131031182606197_0016_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:34:43,397 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000000
2013-10-31 18:34:43,399 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:34:43,400 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000000_0 which needs 1 slots
2013-10-31 18:34:43,400 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000000_0 which needs 1 slots
2013-10-31 18:34:43,430 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_1092332295
2013-10-31 18:34:43,430 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_1092332295 spawned.
2013-10-31 18:34:43,432 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000000_0/taskjvm.sh
2013-10-31 18:34:43,433 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000001_0' to tip task_20131031182606197_0016_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:34:43,433 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000001
2013-10-31 18:34:43,434 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000002_0' to tip task_20131031182606197_0016_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:43,434 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:34:43,434 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000002
2013-10-31 18:34:43,434 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000001_0 which needs 1 slots
2013-10-31 18:34:43,434 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000001_0 which needs 1 slots
2013-10-31 18:34:43,435 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0016_m_000003_0' to tip task_20131031182606197_0016_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:34:43,435 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0016_m_000003
2013-10-31 18:34:43,435 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:34:43,435 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000002_0 which needs 1 slots
2013-10-31 18:34:43,436 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000002_0 which needs 1 slots
2013-10-31 18:34:43,436 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:34:43,437 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000003_0 which needs 1 slots
2013-10-31 18:34:43,437 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000003_0 which needs 1 slots
2013-10-31 18:34:43,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken dst=null perm=null
2013-10-31 18:34:43,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken dst=null perm=null
2013-10-31 18:34:43,444 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43375, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 303720
2013-10-31 18:34:43,444 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43374, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3357374393869421348_1162, duration: 289913
2013-10-31 18:34:43,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=null
2013-10-31 18:34:43,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=null
2013-10-31 18:34:43,457 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50181, bytes: 27661, op: HDFS_READ, cliID: DFSClient_1444728494, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 390518
2013-10-31 18:34:43,457 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50182, bytes: 27661, op: HDFS_READ, cliID: DFSClient_-173508879, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 404911
2013-10-31 18:34:43,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016/jobToken dst=null perm=null
2013-10-31 18:34:43,483 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47554, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3357374393869421348_1162, duration: 260212
2013-10-31 18:34:43,486 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.xml dst=null perm=null
2013-10-31 18:34:43,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50185, bytes: 27661, op: HDFS_READ, cliID: DFSClient_2042374937, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7100172975871123190_1159, duration: 190214
2013-10-31 18:34:43,504 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,514 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:34:43,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=null
2013-10-31 18:34:43,519 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43383, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-173508879, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6758522467386195759_1156, duration: 1432319
2013-10-31 18:34:43,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=null
2013-10-31 18:34:43,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.jar dst=null perm=null
2013-10-31 18:34:43,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47275, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1444728494, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 636787
2013-10-31 18:34:43,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47276, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2042374937, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6758522467386195759_1156, duration: 679386
2013-10-31 18:34:43,820 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_91562867
2013-10-31 18:34:43,821 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_2027104624
2013-10-31 18:34:43,822 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_91562867 spawned.
2013-10-31 18:34:43,821 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_-1174497248
2013-10-31 18:34:43,823 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_2027104624 spawned.
2013-10-31 18:34:43,825 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_-1174497248 spawned.
2013-10-31 18:34:43,828 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000001_0/taskjvm.sh
2013-10-31 18:34:43,828 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000003_0/taskjvm.sh
2013-10-31 18:34:43,829 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000002_0/taskjvm.sh
2013-10-31 18:34:45,438 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_1092332295 given task: attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:45,444 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_2027104624 given task: attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:45,445 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_-1174497248 given task: attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:45,450 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_91562867 given task: attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:45,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=null
2013-10-31 18:34:45,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=null
2013-10-31 18:34:45,942 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47568, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 171057
2013-10-31 18:34:45,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=null
2013-10-31 18:34:45,947 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47569, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6399496362179302068_1157, duration: 170981
2013-10-31 18:34:45,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47287, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 141356
2013-10-31 18:34:45,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016/job.split dst=null perm=null
2013-10-31 18:34:45,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47288, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6399496362179302068_1157, duration: 105976
2013-10-31 18:34:45,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:45,981 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47572, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 108880
2013-10-31 18:34:45,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:45,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:45,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47290, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 146225
2013-10-31 18:34:45,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:34:45,997 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50203, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 168400
2013-10-31 18:34:46,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:46,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:46,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50204, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 201780
2013-10-31 18:34:46,560 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000. blk_8795753558913403673_1166
2013-10-31 18:34:46,561 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002. blk_9090210315426494664_1166
2013-10-31 18:34:46,561 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003. blk_-4627257443058578093_1166
2013-10-31 18:34:46,563 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001. blk_-9072667424849248381_1166
2013-10-31 18:34:46,586 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:47295 dest: /127.0.0.1:37740
2013-10-31 18:34:46,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:47580 dest: /127.0.0.1:54365
2013-10-31 18:34:46,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:47296 dest: /127.0.0.1:37740
2013-10-31 18:34:46,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:43408 dest: /127.0.0.1:59471
2013-10-31 18:34:46,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4627257443058578093_1166 src: /127.0.0.1:43407 dest: /127.0.0.1:59471
2013-10-31 18:34:46,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9072667424849248381_1166 src: /127.0.0.1:47583 dest: /127.0.0.1:54365
2013-10-31 18:34:46,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:47577 dest: /127.0.0.1:54365
2013-10-31 18:34:46,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47583, dest: /127.0.0.1:54365, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072667424849248381_1166, duration: 225425
2013-10-31 18:34:46,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:47301 dest: /127.0.0.1:37740
2013-10-31 18:34:46,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43407, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4627257443058578093_1166, duration: 2643600
2013-10-31 18:34:46,592 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43408, dest: /127.0.0.1:59471, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9072667424849248381_1166, duration: 633726
2013-10-31 18:34:46,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,593 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9090210315426494664_1166 src: /127.0.0.1:50214 dest: /127.0.0.1:34578
2013-10-31 18:34:46,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:47576 dest: /127.0.0.1:54365
2013-10-31 18:34:46,595 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47296, dest: /127.0.0.1:37740, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9072667424849248381_1166, duration: 3206844
2013-10-31 18:34:46,595 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9072667424849248381_1166 terminating
2013-10-31 18:34:46,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47580, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4627257443058578093_1166, duration: 2169314
2013-10-31 18:34:46,598 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:50215 dest: /127.0.0.1:34578
2013-10-31 18:34:46,599 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,600 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50214, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9090210315426494664_1166, duration: 891321
2013-10-31 18:34:46,600 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47295, dest: /127.0.0.1:37740, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4627257443058578093_1166, duration: 10689217
2013-10-31 18:34:46,598 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,600 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47301, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9090210315426494664_1166, duration: 2089921
2013-10-31 18:34:46,601 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:46,601 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,600 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4627257443058578093_1166 terminating
2013-10-31 18:34:46,601 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47577, dest: /127.0.0.1:54365, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9090210315426494664_1166, duration: 2766644
2013-10-31 18:34:46,600 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,601 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9090210315426494664_1166 terminating
2013-10-31 18:34:46,601 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:46,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8795753558913403673_1166 src: /127.0.0.1:47304 dest: /127.0.0.1:37740
2013-10-31 18:34:46,602 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:46,602 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:46,602 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9072667424849248381_1166 size 217
2013-10-31 18:34:46,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4627257443058578093_1166 size 264
2013-10-31 18:34:46,603 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9090210315426494664_1166 size 70
2013-10-31 18:34:46,605 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47304, dest: /127.0.0.1:37740, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8795753558913403673_1166, duration: 1096360
2013-10-31 18:34:46,605 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,605 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50215, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8795753558913403673_1166, duration: 1473579
2013-10-31 18:34:46,605 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,606 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47576, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0016_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8795753558913403673_1166, duration: 1856587
2013-10-31 18:34:46,606 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8795753558913403673_1166 terminating
2013-10-31 18:34:46,608 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,608 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,609 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8795753558913403673_1166 size 264
2013-10-31 18:34:46,648 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:46,648 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 0.0%
2013-10-31 18:34:46,657 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:46,657 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 0.0%
2013-10-31 18:34:47,004 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:47,005 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:47,008 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:47,008 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:47,069 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:47,069 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 0.0%
2013-10-31 18:34:47,076 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0016_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:34:47,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 0.0%
2013-10-31 18:34:48,400 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:48,400 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0016_m_000005_0
2013-10-31 18:34:48,401 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000005_0 not found in cache
2013-10-31 18:34:49,404 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000000_0
2013-10-31 18:34:49,439 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000001_0
2013-10-31 18:34:49,441 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000002_0
2013-10-31 18:34:49,441 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0016_m_000003_0
2013-10-31 18:34:49,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0 dst=null perm=null
2013-10-31 18:34:49,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:49,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0 dst=null perm=null
2013-10-31 18:34:49,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:49,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:49,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000001_0 dst=null perm=null
2013-10-31 18:34:49,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:49,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000003_0 dst=null perm=null
2013-10-31 18:34:50,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0 dst=null perm=null
2013-10-31 18:34:50,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:50,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0 dst=null perm=null
2013-10-31 18:34:50,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:50,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:50,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:50,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000002_0 dst=null perm=null
2013-10-31 18:34:50,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary/_attempt_20131031182606197_0016_m_000000_0 dst=null perm=null
2013-10-31 18:34:51,919 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:51,921 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:34:51,921 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000000_0 is done.
2013-10-31 18:34:51,921 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000000_0 was -1
2013-10-31 18:34:51,921 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:51,921 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,923 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:34:51,924 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000001_0 is done.
2013-10-31 18:34:51,924 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000001_0 was -1
2013-10-31 18:34:51,924 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,934 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:51,936 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:34:51,937 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000002_0 is done.
2013-10-31 18:34:51,937 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000002_0 was -1
2013-10-31 18:34:51,937 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:51,937 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:51,939 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:34:51,940 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000003_0 is done.
2013-10-31 18:34:51,940 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000003_0 was -1
2013-10-31 18:34:51,940 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:52,408 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000000_0' has completed task_20131031182606197_0016_m_000000 successfully.
2013-10-31 18:34:52,443 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000001_0' has completed task_20131031182606197_0016_m_000001 successfully.
2013-10-31 18:34:52,446 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000003_0' has completed task_20131031182606197_0016_m_000003 successfully.
2013-10-31 18:34:52,448 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000002_0' has completed task_20131031182606197_0016_m_000002 successfully.
2013-10-31 18:34:52,451 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0016_m_000004_0' to tip task_20131031182606197_0016_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:34:52,488 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0016_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:34:52,489 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0016_m_000004_0 which needs 1 slots
2013-10-31 18:34:52,489 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0016_m_000004_0 which needs 1 slots
2013-10-31 18:34:52,525 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0016_m_528033224
2013-10-31 18:34:52,526 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0016_m_528033224 spawned.
2013-10-31 18:34:52,528 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0016/attempt_20131031182606197_0016_m_000004_0/taskjvm.sh
2013-10-31 18:34:53,370 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0016_m_528033224 given task: attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:53,907 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000004_0 0.0%
2013-10-31 18:34:53,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_temporary dst=null perm=null
2013-10-31 18:34:54,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:54,021 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS from client DFSClient_attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:54,022 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0016_m_000004_0
2013-10-31 18:34:54,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,029 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,029 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,029 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6758522467386195759 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,029 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,030 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,030 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,030 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6399496362179302068 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,030 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,031 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:54,031 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3213097698103852867 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,031 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:34:54,031 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:54,032 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7100172975871123190 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:54,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0016 dst=null perm=null
2013-10-31 18:34:55,439 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_7100172975871123190_1159 blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:55,440 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_7100172975871123190_1159 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:34:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,033 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,043 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,049 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:34:56,049 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:34:56,819 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0016_m_000004_0 0.0% cleanup
2013-10-31 18:34:56,820 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0016_m_000004_0 is done.
2013-10-31 18:34:56,821 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0016_m_000004_0 was -1
2013-10-31 18:34:56,821 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:34:57,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data2/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:57,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data2/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:57,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data2/current/blk_-6758522467386195759
2013-10-31 18:34:57,204 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data1/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:57,205 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data2/current/blk_-3213097698103852867
2013-10-31 18:34:57,205 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data1/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:57,205 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data1/current/blk_6399496362179302068
2013-10-31 18:34:57,206 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data1/current/blk_7100172975871123190
2013-10-31 18:34:57,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data7/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:57,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data8/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:57,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data7/current/blk_-6758522467386195759
2013-10-31 18:34:57,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data8/current/blk_6399496362179302068
2013-10-31 18:34:57,277 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data7/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:57,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data7/current/blk_7100172975871123190
2013-10-31 18:34:58,440 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_7100172975871123190_1159 blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:58,440 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-3213097698103852867_1158 blk_6399496362179302068_1157 blk_-6758522467386195759_1156
2013-10-31 18:34:58,496 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0016_m_000004_0' has completed task_20131031182606197_0016_m_000004 successfully.
2013-10-31 18:34:58,497 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0016 has completed successfully.
2013-10-31 18:34:58,497 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0016,submitTime=1383244475128,launchTime=1383244475632,firstMapTaskLaunchTime=1383244483396,firstJobSetupTaskLaunchTime=1383244477378,firstJobCleanupTaskLaunchTime=1383244492451,finishTime=1383244498497,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=43,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D04322ECDC9F4E7281BF003BCAE07C61/69BDD30D16B646CC9BA938D95DF4A337] merged/(1/2)
2013-10-31 18:34:58,506 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC. blk_2087420957165246899_1167
2013-10-31 18:34:58,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:43418 dest: /127.0.0.1:59471
2013-10-31 18:34:58,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:47593 dest: /127.0.0.1:54365
2013-10-31 18:34:58,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2087420957165246899_1167 src: /127.0.0.1:47311 dest: /127.0.0.1:37740
2013-10-31 18:34:58,521 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47311, dest: /127.0.0.1:37740, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2087420957165246899_1167, duration: 4835298
2013-10-31 18:34:58,522 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,522 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47593, dest: /127.0.0.1:54365, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2087420957165246899_1167, duration: 5488386
2013-10-31 18:34:58,522 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43418, dest: /127.0.0.1:59471, bytes: 22429, op: HDFS_WRITE, cliID: DFSClient_2100615146, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2087420957165246899_1167, duration: 7226611
2013-10-31 18:34:58,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2087420957165246899_1167 terminating
2013-10-31 18:34:58,527 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC from client DFSClient_2100615146
2013-10-31 18:34:58,527 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/_logs/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC is closed by DFSClient_2100615146
2013-10-31 18:34:58,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,528 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2087420957165246899_1167 size 22429
2013-10-31 18:34:58,535 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0016_1383244475128_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F69BDD30D16B646CC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:58,537 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000002_0'
2013-10-31 18:34:58,537 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000004_0'
2013-10-31 18:34:58,537 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:34:58,539 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:34:58,539 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3357374393869421348 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:34:58,539 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0016_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:34:58,543 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (2/2) ...latform/splitsourcemerged
2013-10-31 18:34:58,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0016 dst=null perm=null
2013-10-31 18:34:58,547 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:34:58,547 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:34:58,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:34:58,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:34:58,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,569 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar. blk_-1767724206513468299_1168
2013-10-31 18:34:58,571 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:43422 dest: /127.0.0.1:59471
2013-10-31 18:34:58,573 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:47597 dest: /127.0.0.1:54365
2013-10-31 18:34:58,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:50227 dest: /127.0.0.1:34578
2013-10-31 18:34:58,589 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50227, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 11883355
2013-10-31 18:34:58,590 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,590 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47597, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1767724206513468299_1168, duration: 12649974
2013-10-31 18:34:58,591 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,591 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43422, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1767724206513468299_1168, duration: 13692930
2013-10-31 18:34:58,592 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1767724206513468299_1168 terminating
2013-10-31 18:34:58,593 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,594 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar from client DFSClient_-1596270109
2013-10-31 18:34:58,594 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:34:58,594 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,595 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:34:58,600 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar. New replication is 10
2013-10-31 18:34:58,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=null
2013-10-31 18:34:58,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,611 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:34:58,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=null
2013-10-31 18:34:58,616 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:34:58,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000 dst=null perm=null
2013-10-31 18:34:58,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001 dst=null perm=null
2013-10-31 18:34:58,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002 dst=null perm=null
2013-10-31 18:34:58,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003 dst=null perm=null
2013-10-31 18:34:58,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,634 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split. New replication is 10
2013-10-31 18:34:58,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=null
2013-10-31 18:34:58,641 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split. blk_4501709775066199659_1169
2013-10-31 18:34:58,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:47316 dest: /127.0.0.1:37740
2013-10-31 18:34:58,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:43426 dest: /127.0.0.1:59471
2013-10-31 18:34:58,646 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:50230 dest: /127.0.0.1:34578
2013-10-31 18:34:58,647 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4501709775066199659_1169 src: /127.0.0.1:47602 dest: /127.0.0.1:54365
2013-10-31 18:34:58,651 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47602, dest: /127.0.0.1:54365, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 98728
2013-10-31 18:34:58,652 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,652 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50230, dest: /127.0.0.1:34578, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4501709775066199659_1169, duration: 928134
2013-10-31 18:34:58,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,653 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43426, dest: /127.0.0.1:59471, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4501709775066199659_1169, duration: 1925262
2013-10-31 18:34:58,653 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,654 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47316, dest: /127.0.0.1:37740, bytes: 1383, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4501709775066199659_1169, duration: 2742555
2013-10-31 18:34:58,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,654 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_4501709775066199659_1169 terminating
2013-10-31 18:34:58,658 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,659 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split from client DFSClient_-1596270109
2013-10-31 18:34:58,659 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split is closed by DFSClient_-1596270109
2013-10-31 18:34:58,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,660 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4501709775066199659_1169 size 1383
2013-10-31 18:34:58,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,678 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo. blk_3023221613854610402_1170
2013-10-31 18:34:58,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:47603 dest: /127.0.0.1:54365
2013-10-31 18:34:58,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:50233 dest: /127.0.0.1:34578
2013-10-31 18:34:58,683 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3023221613854610402_1170 src: /127.0.0.1:43431 dest: /127.0.0.1:59471
2013-10-31 18:34:58,686 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43431, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3023221613854610402_1170, duration: 66389
2013-10-31 18:34:58,686 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50233, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3023221613854610402_1170, duration: 857793
2013-10-31 18:34:58,687 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47603, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3023221613854610402_1170, duration: 1876745
2013-10-31 18:34:58,688 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,688 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3023221613854610402_1170 terminating
2013-10-31 18:34:58,691 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3023221613854610402_1170 size 153
2013-10-31 18:34:58,692 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:34:58,693 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:34:58,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:58,717 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml. blk_4560125798104689975_1171
2013-10-31 18:34:58,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:50235 dest: /127.0.0.1:34578
2013-10-31 18:34:58,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:47324 dest: /127.0.0.1:37740
2013-10-31 18:34:58,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4560125798104689975_1171 src: /127.0.0.1:47608 dest: /127.0.0.1:54365
2013-10-31 18:34:58,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47608, dest: /127.0.0.1:54365, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4560125798104689975_1171, duration: 355449
2013-10-31 18:34:58,725 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47324, dest: /127.0.0.1:37740, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 1194467
2013-10-31 18:34:58,726 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,726 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:58,726 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50235, dest: /127.0.0.1:34578, bytes: 28310, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 2073696
2013-10-31 18:34:58,727 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:58,727 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4560125798104689975_1171 terminating
2013-10-31 18:34:58,729 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml from client DFSClient_-1596270109
2013-10-31 18:34:58,730 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:34:58,731 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4560125798104689975_1171 size 28310
2013-10-31 18:34:59,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data3/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:59,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data3/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:59,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data3/current/blk_-6758522467386195759
2013-10-31 18:34:59,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data4/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:59,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data3/current/blk_-3213097698103852867
2013-10-31 18:34:59,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7100172975871123190_1159 file build/test/data/dfs/data/data4/current/blk_7100172975871123190 for deletion
2013-10-31 18:34:59,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data4/current/blk_6399496362179302068
2013-10-31 18:34:59,081 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7100172975871123190_1159 at file build/test/data/dfs/data/data4/current/blk_7100172975871123190
2013-10-31 18:34:59,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=null
2013-10-31 18:34:59,468 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50239, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 410963
2013-10-31 18:34:59,483 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0017: nMaps=4 nReduces=1 max=-1
2013-10-31 18:34:59,483 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0017 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:34:59,484 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0017 RESULT=SUCCESS
2013-10-31 18:34:59,484 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0017
2013-10-31 18:34:59,484 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0017
2013-10-31 18:34:59,484 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0017
2013-10-31 18:34:59,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,510 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml. blk_-2582993331910526702_1173
2013-10-31 18:34:59,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:43437 dest: /127.0.0.1:59471
2013-10-31 18:34:59,513 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:50241 dest: /127.0.0.1:34578
2013-10-31 18:34:59,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2582993331910526702_1173 src: /127.0.0.1:47330 dest: /127.0.0.1:37740
2013-10-31 18:34:59,519 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47330, dest: /127.0.0.1:37740, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2582993331910526702_1173, duration: 609252
2013-10-31 18:34:59,519 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,519 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50241, dest: /127.0.0.1:34578, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2582993331910526702_1173, duration: 1040557
2013-10-31 18:34:59,520 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,520 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43437, dest: /127.0.0.1:59471, bytes: 28375, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2582993331910526702_1173, duration: 1863139
2013-10-31 18:34:59,521 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2582993331910526702_1173 terminating
2013-10-31 18:34:59,522 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,523 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,524 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2582993331910526702_1173 size 28375
2013-10-31 18:34:59,808 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6758522467386195759_1156 file build/test/data/dfs/data/data6/current/blk_-6758522467386195759 for deletion
2013-10-31 18:34:59,808 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3213097698103852867_1158 file build/test/data/dfs/data/data5/current/blk_-3213097698103852867 for deletion
2013-10-31 18:34:59,808 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6758522467386195759_1156 at file build/test/data/dfs/data/data6/current/blk_-6758522467386195759
2013-10-31 18:34:59,808 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6399496362179302068_1157 file build/test/data/dfs/data/data6/current/blk_6399496362179302068 for deletion
2013-10-31 18:34:59,808 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3213097698103852867_1158 at file build/test/data/dfs/data/data5/current/blk_-3213097698103852867
2013-10-31 18:34:59,809 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6399496362179302068_1157 at file build/test/data/dfs/data/data6/current/blk_6399496362179302068
2013-10-31 18:34:59,922 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml from client DFSClient_-620184378
2013-10-31 18:34:59,923 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_conf.xml is closed by DFSClient_-620184378
2013-10-31 18:34:59,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:34:59,937 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken. blk_5683982942081372135_1174
2013-10-31 18:34:59,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:50243 dest: /127.0.0.1:34578
2013-10-31 18:34:59,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:47332 dest: /127.0.0.1:37740
2013-10-31 18:34:59,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5683982942081372135_1174 src: /127.0.0.1:43442 dest: /127.0.0.1:59471
2013-10-31 18:34:59,946 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43442, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 87959
2013-10-31 18:34:59,947 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,947 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47332, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5683982942081372135_1174, duration: 1147507
2013-10-31 18:34:59,947 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,948 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50243, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 2017936
2013-10-31 18:34:59,948 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,949 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5683982942081372135_1174 terminating
2013-10-31 18:34:59,952 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,953 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken from client DFSClient_-1596270109
2013-10-31 18:34:59,953 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:34:59,954 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5683982942081372135_1174 size 116
2013-10-31 18:34:59,958 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken
2013-10-31 18:34:59,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.splitmetainfo dst=null perm=null
2013-10-31 18:34:59,963 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43443, bytes: 157, op: HDFS_READ, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3023221613854610402_1170, duration: 349669
2013-10-31 18:34:59,964 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0017 = 815. Number of splits = 4
2013-10-31 18:34:59,964 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,964 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,965 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,966 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0017_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:34:59,967 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0017 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:34:59,968 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0017 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:35:01,422 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0017_m_000005_0' to tip task_20131031182606197_0017_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:01,427 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000000_0'
2013-10-31 18:35:01,427 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000005_0'
2013-10-31 18:35:01,429 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:01,429 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000005_0 which needs 1 slots
2013-10-31 18:35:01,429 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000005_0 which needs 1 slots
2013-10-31 18:35:01,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken dst=null perm=null
2013-10-31 18:35:01,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50247, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 322189
2013-10-31 18:35:01,442 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-1767724206513468299_1168 to datanode(s) 127.0.0.1:37740
2013-10-31 18:35:01,442 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_3357374393869421348_1162
2013-10-31 18:35:01,443 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_3357374393869421348_1162
2013-10-31 18:35:01,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=null
2013-10-31 18:35:01,449 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47337, bytes: 28534, op: HDFS_READ, cliID: DFSClient_233648399, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 389921
2013-10-31 18:35:01,456 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000001_0'
2013-10-31 18:35:01,458 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0016_m_000003_0'
2013-10-31 18:35:01,481 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:01,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=null
2013-10-31 18:35:01,512 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_233648399, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 1235120
2013-10-31 18:35:01,592 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0016_m_1092332295
2013-10-31 18:35:01,599 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25282 with signal TERM. Exit code 0
2013-10-31 18:35:01,600 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_-371996203
2013-10-31 18:35:01,603 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_-371996203 spawned.
2013-10-31 18:35:01,605 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000005_0/taskjvm.sh
2013-10-31 18:35:01,675 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:01,675 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:01,675 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:01,676 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_1092332295 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:02,079 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data4/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:02,080 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data4/current/blk_3357374393869421348
2013-10-31 18:35:02,831 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_-371996203 given task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:03,205 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-1767724206513468299_1168 to 127.0.0.1:37740
2013-10-31 18:35:03,206 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data2/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:03,206 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data2/current/blk_3357374393869421348
2013-10-31 18:35:03,206 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1767724206513468299_1168 src: /127.0.0.1:47340 dest: /127.0.0.1:37740
2013-10-31 18:35:03,206 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-1767724206513468299_1168 to /127.0.0.1:37740
2013-10-31 18:35:03,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1767724206513468299_1168 src: /127.0.0.1:47340 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:35:03,211 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1767724206513468299_1168 size 238055
2013-10-31 18:35:03,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:03,538 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:03,538 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000004_0 not found in cache
2013-10-31 18:35:03,538 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000002_0 not found in cache
2013-10-31 18:35:03,539 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330903539
2013-10-31 18:35:04,443 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_3357374393869421348_1162
2013-10-31 18:35:04,465 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_-1174497248 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:04,476 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25287 with signal TERM. Exit code 0
2013-10-31 18:35:04,681 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:04,681 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:04,681 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:04,681 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_-1174497248 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:04,885 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_528033224 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:04,895 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25558 with signal TERM. Exit code 0
2013-10-31 18:35:05,067 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:05,067 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:05,067 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:05,067 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_528033224 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:05,810 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3357374393869421348_1162 file build/test/data/dfs/data/data5/current/blk_3357374393869421348 for deletion
2013-10-31 18:35:05,811 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3357374393869421348_1162 at file build/test/data/dfs/data/data5/current/blk_3357374393869421348
2013-10-31 18:35:06,258 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000005_0 0.0% setup
2013-10-31 18:35:06,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000005_0 is done.
2013-10-31 18:35:06,261 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000005_0 was -1
2013-10-31 18:35:06,261 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:06,429 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,430 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000000_0 not found in cache
2013-10-31 18:35:06,430 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906430
2013-10-31 18:35:06,456 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,456 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000001_0 not found in cache
2013-10-31 18:35:06,457 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906457
2013-10-31 18:35:06,459 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0016
2013-10-31 18:35:06,459 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0016_m_000003_0 not found in cache
2013-10-31 18:35:06,460 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0016 for user-log deletion with retainTimeStamp:1383330906460
2013-10-31 18:35:06,630 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_386164469 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:06,638 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25106 with signal TERM. Exit code 0
2013-10-31 18:35:06,879 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:06,879 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:06,879 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:06,879 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_386164469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:07,435 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000005_0' has completed task_20131031182606197_0017_m_000005 successfully.
2013-10-31 18:35:07,439 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000000_0' to tip task_20131031182606197_0017_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:07,457 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000000
2013-10-31 18:35:07,459 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:07,460 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000000_0 which needs 1 slots
2013-10-31 18:35:07,460 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000000_0 which needs 1 slots
2013-10-31 18:35:07,462 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_91562867 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:07,467 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000001_0' to tip task_20131031182606197_0017_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:35:07,468 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000001
2013-10-31 18:35:07,468 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25285 with signal TERM. Exit code 0
2013-10-31 18:35:07,470 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:35:07,470 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000002_0' to tip task_20131031182606197_0017_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:35:07,470 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000001_0 which needs 1 slots
2013-10-31 18:35:07,471 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000002
2013-10-31 18:35:07,471 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000001_0 which needs 1 slots
2013-10-31 18:35:07,472 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:35:07,473 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0016_m_2027104624 since job job_20131031182606197_0016 is dead
2013-10-31 18:35:07,473 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000002_0 which needs 1 slots
2013-10-31 18:35:07,474 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000002_0 which needs 1 slots
2013-10-31 18:35:07,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken dst=null perm=null
2013-10-31 18:35:07,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken dst=null perm=null
2013-10-31 18:35:07,480 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25286 with signal TERM. Exit code 0
2013-10-31 18:35:07,480 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43451, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 598456
2013-10-31 18:35:07,489 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50255, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5683982942081372135_1174, duration: 127062
2013-10-31 18:35:07,489 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_204403117
2013-10-31 18:35:07,490 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_204403117 spawned.
2013-10-31 18:35:07,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=null
2013-10-31 18:35:07,492 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000000_0/taskjvm.sh
2013-10-31 18:35:07,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=null
2013-10-31 18:35:07,493 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47346, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-549701899, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 184653
2013-10-31 18:35:07,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50259, bytes: 28534, op: HDFS_READ, cliID: DFSClient_-1442932776, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4560125798104689975_1171, duration: 171533
2013-10-31 18:35:07,508 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,508 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,545 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0017_m_000003_0' to tip task_20131031182606197_0017_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:07,545 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0017_m_000003
2013-10-31 18:35:07,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=null
2013-10-31 18:35:07,547 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:35:07,547 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000003_0 which needs 1 slots
2013-10-31 18:35:07,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=null
2013-10-31 18:35:07,547 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000003_0 which needs 1 slots
2013-10-31 18:35:07,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47631, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1442932776, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1767724206513468299_1168, duration: 924625
2013-10-31 18:35:07,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017/jobToken dst=null perm=null
2013-10-31 18:35:07,551 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50261, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-549701899, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1767724206513468299_1168, duration: 1391822
2013-10-31 18:35:07,553 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43459, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5683982942081372135_1174, duration: 225668
2013-10-31 18:35:07,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.xml dst=null perm=null
2013-10-31 18:35:07,559 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47352, bytes: 28534, op: HDFS_READ, cliID: DFSClient_956388042, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4560125798104689975_1171, duration: 215709
2013-10-31 18:35:07,573 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:07,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.jar dst=null perm=null
2013-10-31 18:35:07,588 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47353, bytes: 239915, op: HDFS_READ, cliID: DFSClient_956388042, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1767724206513468299_1168, duration: 644551
2013-10-31 18:35:07,611 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_1734978570
2013-10-31 18:35:07,612 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_1734978570 spawned.
2013-10-31 18:35:07,613 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000002_0/taskjvm.sh
2013-10-31 18:35:07,614 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_502438488
2013-10-31 18:35:07,615 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_502438488 spawned.
2013-10-31 18:35:07,616 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000001_0/taskjvm.sh
2013-10-31 18:35:07,642 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_m_-172444087
2013-10-31 18:35:07,643 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_m_-172444087 spawned.
2013-10-31 18:35:07,644 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:07,644 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_m_000003_0/taskjvm.sh
2013-10-31 18:35:07,644 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:07,644 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:07,644 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_91562867 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:07,646 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:07,646 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:07,646 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:07,646 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0016_m_2027104624 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:08,335 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_204403117 given task: attempt_20131031182606197_0017_m_000000_0
2013-10-31 18:35:08,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=null
2013-10-31 18:35:08,985 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47639, bytes: 1395, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 176459
2013-10-31 18:35:09,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000 dst=null perm=null
2013-10-31 18:35:09,024 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50269, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8795753558913403673_1166, duration: 131378
2013-10-31 18:35:09,529 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_1734978570 given task: attempt_20131031182606197_0017_m_000002_0
2013-10-31 18:35:09,640 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_502438488 given task: attempt_20131031182606197_0017_m_000001_0
2013-10-31 18:35:09,646 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_-172444087 given task: attempt_20131031182606197_0017_m_000003_0
2013-10-31 18:35:10,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=null
2013-10-31 18:35:10,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47645, bytes: 879, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 172339
2013-10-31 18:35:10,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001 dst=null perm=null
2013-10-31 18:35:10,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47648, bytes: 221, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9072667424849248381_1166, duration: 125278
2013-10-31 18:35:10,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=null
2013-10-31 18:35:10,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47649, bytes: 1395, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 181606
2013-10-31 18:35:10,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017/job.split dst=null perm=null
2013-10-31 18:35:10,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47650, bytes: 363, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4501709775066199659_1169, duration: 103109
2013-10-31 18:35:10,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003 dst=null perm=null
2013-10-31 18:35:10,184 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43477, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4627257443058578093_1166, duration: 105707
2013-10-31 18:35:10,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002 dst=null perm=null
2013-10-31 18:35:10,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50281, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0017_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9090210315426494664_1166, duration: 106101
2013-10-31 18:35:11,915 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00000:0+264
2013-10-31 18:35:11,918 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000000_0 is done.
2013-10-31 18:35:11,918 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000000_0 was 196
2013-10-31 18:35:11,918 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:12,460 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:12,460 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0017_m_000005_0
2013-10-31 18:35:12,460 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0017_m_000005_0 not found in cache
2013-10-31 18:35:12,976 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00001:0+217
2013-10-31 18:35:12,979 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000002_0 is done.
2013-10-31 18:35:12,979 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000002_0 was 149
2013-10-31 18:35:12,980 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00003:0+264
2013-10-31 18:35:13,080 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000001_0 is done.
2013-10-31 18:35:13,080 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000001_0 was 196
2013-10-31 18:35:13,081 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,093 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C/part-00002:0+70
2013-10-31 18:35:13,096 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000003_0 is done.
2013-10-31 18:35:13,096 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000003_0 was 6
2013-10-31 18:35:13,097 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:13,463 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000000_0' has completed task_20131031182606197_0017_m_000000 successfully.
2013-10-31 18:35:13,465 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0017_r_000000_0' to tip task_20131031182606197_0017_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:13,467 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:13,468 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_r_000000_0 which needs 1 slots
2013-10-31 18:35:13,468 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_r_000000_0 which needs 1 slots
2013-10-31 18:35:13,474 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000001_0' has completed task_20131031182606197_0017_m_000001 successfully.
2013-10-31 18:35:13,477 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000002_0' has completed task_20131031182606197_0017_m_000002 successfully.
2013-10-31 18:35:13,486 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0017_r_-1261202210
2013-10-31 18:35:13,487 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0017_r_-1261202210 spawned.
2013-10-31 18:35:13,490 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0017/attempt_20131031182606197_0017_r_000000_0/taskjvm.sh
2013-10-31 18:35:13,553 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000003_0' has completed task_20131031182606197_0017_m_000003 successfully.
2013-10-31 18:35:14,518 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_r_-1261202210 given task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:20,188 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44363, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000000_0, duration: 9250476
2013-10-31 18:35:20,213 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49322, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000001_0, duration: 10982992
2013-10-31 18:35:20,226 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39668, bytes: 149, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000002_0, duration: 8351218
2013-10-31 18:35:20,239 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41690, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0017_m_000003_0, duration: 9487880
2013-10-31 18:35:21,012 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,062 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,118 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:21,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:21,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:21,338 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000. blk_1977604624338997367_1175
2013-10-31 18:35:21,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:47660 dest: /127.0.0.1:54365
2013-10-31 18:35:21,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:43487 dest: /127.0.0.1:59471
2013-10-31 18:35:21,361 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1977604624338997367_1175 src: /127.0.0.1:47379 dest: /127.0.0.1:37740
2013-10-31 18:35:21,365 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47379, dest: /127.0.0.1:37740, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 2728712
2013-10-31 18:35:21,365 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,366 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43487, dest: /127.0.0.1:59471, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1977604624338997367_1175, duration: 3429618
2013-10-31 18:35:21,366 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,366 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47660, dest: /127.0.0.1:54365, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0017_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1977604624338997367_1175, duration: 3690325
2013-10-31 18:35:21,366 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1977604624338997367_1175 terminating
2013-10-31 18:35:21,370 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,370 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:21,370 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:21,370 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,371 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1977604624338997367_1175 size 495
2013-10-31 18:35:21,406 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0017_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:21,406 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:35:22,478 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0017_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:35:22,479 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:23,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0 dst=null perm=null
2013-10-31 18:35:23,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:23,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:23,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary/_attempt_20131031182606197_0017_r_000000_0 dst=null perm=null
2013-10-31 18:35:24,061 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 18:35:24,063 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_r_000000_0 1.0% reduce > reduce
2013-10-31 18:35:24,064 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_r_000000_0 is done.
2013-10-31 18:35:24,064 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_r_000000_0 was -1
2013-10-31 18:35:24,064 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:25,483 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_r_000000_0' has completed task_20131031182606197_0017_r_000000 successfully.
2013-10-31 18:35:25,487 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0017_m_000004_0' to tip task_20131031182606197_0017_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:25,490 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0017_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:35:25,490 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0017_m_000004_0 which needs 1 slots
2013-10-31 18:35:25,491 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0017_m_000004_0 which needs 1 slots
2013-10-31 18:35:25,528 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0017/attempt_20131031182606197_0017_m_000004_0. Attempting to reuse: jvm_20131031182606197_0017_m_204403117
2013-10-31 18:35:25,990 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0017_m_204403117 given task: attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,137 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000004_0 0.0%
2013-10-31 18:35:26,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary dst=null perm=null
2013-10-31 18:35:26,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:26,154 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS from client DFSClient_attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,154 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0017_m_000004_0
2013-10-31 18:35:26,268 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,269 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,269 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,269 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1767724206513468299 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,270 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,270 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,270 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,270 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4501709775066199659 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,271 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:26,271 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,271 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3023221613854610402 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,272 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:26,272 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:26,272 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4560125798104689975 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:26,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0017 dst=null perm=null
2013-10-31 18:35:28,460 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:28,460 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_-1767724206513468299_1168
2013-10-31 18:35:29,087 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0017_m_000004_0 0.0% cleanup
2013-10-31 18:35:29,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data4/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:29,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data4/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:29,089 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0017_m_000004_0 is done.
2013-10-31 18:35:29,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data3/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:29,089 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data4/current/blk_-1767724206513468299
2013-10-31 18:35:29,090 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data3/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:29,090 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data4/current/blk_3023221613854610402
2013-10-31 18:35:29,090 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data3/current/blk_4501709775066199659
2013-10-31 18:35:29,090 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0017_m_000004_0 was -1
2013-10-31 18:35:29,091 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data3/current/blk_4560125798104689975
2013-10-31 18:35:29,091 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:30,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data8/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:30,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data8/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:30,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data8/current/blk_-1767724206513468299
2013-10-31 18:35:30,288 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data7/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:30,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data8/current/blk_4501709775066199659
2013-10-31 18:35:30,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data7/current/blk_4560125798104689975
2013-10-31 18:35:30,491 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:30,491 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0017_r_000000_0
2013-10-31 18:35:31,461 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_4501709775066199659_1169 blk_4560125798104689975_1171 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:31,461 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_4501709775066199659_1169 blk_3023221613854610402_1170 blk_-1767724206513468299_1168
2013-10-31 18:35:31,499 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0017_m_000004_0' has completed task_20131031182606197_0017_m_000004 successfully.
2013-10-31 18:35:31,510 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0017 has completed successfully.
2013-10-31 18:35:31,511 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0017,submitTime=1383244499458,launchTime=1383244499967,firstMapTaskLaunchTime=1383244507438,firstReduceTaskLaunchTime=1383244513465,firstJobSetupTaskLaunchTime=1383244501421,firstJobCleanupTaskLaunchTime=1383244525487,finishTime=1383244531510,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D04322ECDC9F4E7281BF003BCAE07C61/2F135A3E8A604AB1BD6A2315B412481F] merged/(2/2) ...latform/splitsourcemerged
2013-10-31 18:35:31,516 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1. blk_-1185965224548220645_1176
2013-10-31 18:35:31,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:43491 dest: /127.0.0.1:59471
2013-10-31 18:35:31,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:50295 dest: /127.0.0.1:34578
2013-10-31 18:35:31,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1185965224548220645_1176 src: /127.0.0.1:47384 dest: /127.0.0.1:37740
2013-10-31 18:35:31,534 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47384, dest: /127.0.0.1:37740, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1185965224548220645_1176, duration: 3677976
2013-10-31 18:35:31,534 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,535 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50295, dest: /127.0.0.1:34578, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1185965224548220645_1176, duration: 3887124
2013-10-31 18:35:31,535 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,536 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43491, dest: /127.0.0.1:59471, bytes: 27800, op: HDFS_WRITE, cliID: DFSClient_-620184378, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1185965224548220645_1176, duration: 4989530
2013-10-31 18:35:31,536 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1185965224548220645_1176 terminating
2013-10-31 18:35:31,539 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,539 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 from client DFSClient_-620184378
2013-10-31 18:35:31,540 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_logs/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 is closed by DFSClient_-620184378
2013-10-31 18:35:31,540 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 928 Total time for transactions(ms): 22Number of transactions batched in Syncs: 83 Number of syncs: 640 SyncTimes(ms): 59291 13013
2013-10-31 18:35:31,540 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,541 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1185965224548220645_1176 size 27800
2013-10-31 18:35:31,547 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0017_1383244499458_hadoop_%5BD04322ECDC9F4E7281BF003BCAE07C61%2F2F135A3E8A604AB1 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:31,548 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000000_0'
2013-10-31 18:35:31,548 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000004_0'
2013-10-31 18:35:31,548 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000005_0'
2013-10-31 18:35:31,549 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_r_000000_0'
2013-10-31 18:35:31,550 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,550 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000002_0'
2013-10-31 18:35:31,550 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,551 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5683982942081372135 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,551 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000001_0'
2013-10-31 18:35:31,554 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0017_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:31,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0017 dst=null perm=null
2013-10-31 18:35:31,558 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,559 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,559 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2087420957165246899 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,559 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,559 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,559 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6789407230370558946 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,560 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,560 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,560 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8795753558913403673 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,560 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,561 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,561 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9072667424849248381 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,561 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,561 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,561 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9090210315426494664 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:31,562 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:31,562 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:31,562 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4627257443058578093 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:31,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/908204918_split_C667AD37363A4EB49720B364531C396C dst=null perm=null
2013-10-31 18:35:31,569 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/_temporary
2013-10-31 18:35:31,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged dst=null perm=null
2013-10-31 18:35:31,590 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:31,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000 dst=null perm=null
2013-10-31 18:35:31,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000 dst=null perm=null
2013-10-31 18:35:31,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47386, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 261282
2013-10-31 18:35:31,596 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitsourcemerged
2013-10-31 18:35:31,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged dst=null perm=null
2013-10-31 18:35:31,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemerged/part-00000 dst=null perm=null
2013-10-31 18:35:31,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47387, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1977604624338997367_1175, duration: 265662
2013-10-31 18:35:31,622 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:35:31,622 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:35:31,630 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:35:31,630 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:35:31,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy"]
2013-10-31 18:35:31,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:35:31,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:35:31,631 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:35:31,632 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/copy
2013-10-31 18:35:31,635 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:35:31,636 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:35:31,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:31,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:35:31,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,654 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar. blk_-5452196635493687275_1177
2013-10-31 18:35:31,655 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:43497 dest: /127.0.0.1:59471
2013-10-31 18:35:31,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:47389 dest: /127.0.0.1:37740
2013-10-31 18:35:31,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:47673 dest: /127.0.0.1:54365
2013-10-31 18:35:31,668 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47673, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5452196635493687275_1177, duration: 6554335
2013-10-31 18:35:31,668 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,669 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47389, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5452196635493687275_1177, duration: 7355340
2013-10-31 18:35:31,669 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,670 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43497, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5452196635493687275_1177, duration: 8627350
2013-10-31 18:35:31,670 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,670 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5452196635493687275_1177 terminating
2013-10-31 18:35:31,674 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,674 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar from client DFSClient_-1596270109
2013-10-31 18:35:31,675 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:35:31,675 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:31,680 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar. New replication is 10
2013-10-31 18:35:31,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=null
2013-10-31 18:35:31,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,691 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:35:31,695 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:31,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:31,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,707 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split. New replication is 10
2013-10-31 18:35:31,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=null
2013-10-31 18:35:31,713 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split. blk_2516087568850634061_1178
2013-10-31 18:35:31,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:47674 dest: /127.0.0.1:54365
2013-10-31 18:35:31,716 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:50304 dest: /127.0.0.1:34578
2013-10-31 18:35:31,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:43502 dest: /127.0.0.1:59471
2013-10-31 18:35:31,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2516087568850634061_1178 src: /127.0.0.1:47394 dest: /127.0.0.1:37740
2013-10-31 18:35:31,723 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47394, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2516087568850634061_1178, duration: 103632
2013-10-31 18:35:31,723 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,723 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43502, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2516087568850634061_1178, duration: 1003593
2013-10-31 18:35:31,724 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,724 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50304, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 1959107
2013-10-31 18:35:31,725 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,725 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47674, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2516087568850634061_1178, duration: 2842169
2013-10-31 18:35:31,726 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,726 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2516087568850634061_1178 terminating
2013-10-31 18:35:31,727 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,728 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split from client DFSClient_-1596270109
2013-10-31 18:35:31,728 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split is closed by DFSClient_-1596270109
2013-10-31 18:35:31,729 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2516087568850634061_1178 size 1403
2013-10-31 18:35:31,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,737 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0017_m_000003_0'
2013-10-31 18:35:31,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,744 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo. blk_4046966012556952094_1179
2013-10-31 18:35:31,745 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:50307 dest: /127.0.0.1:34578
2013-10-31 18:35:31,747 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:43505 dest: /127.0.0.1:59471
2013-10-31 18:35:31,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4046966012556952094_1179 src: /127.0.0.1:47397 dest: /127.0.0.1:37740
2013-10-31 18:35:31,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47397, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4046966012556952094_1179, duration: 66768
2013-10-31 18:35:31,752 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,752 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43505, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4046966012556952094_1179, duration: 863371
2013-10-31 18:35:31,753 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,753 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50307, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4046966012556952094_1179, duration: 1870882
2013-10-31 18:35:31,754 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4046966012556952094_1179 terminating
2013-10-31 18:35:31,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,757 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:35:31,757 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:35:31,758 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,758 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4046966012556952094_1179 size 156
2013-10-31 18:35:31,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:31,778 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml. blk_8250117222170697749_1180
2013-10-31 18:35:31,779 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:50310 dest: /127.0.0.1:34578
2013-10-31 18:35:31,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:47682 dest: /127.0.0.1:54365
2013-10-31 18:35:31,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8250117222170697749_1180 src: /127.0.0.1:47400 dest: /127.0.0.1:37740
2013-10-31 18:35:31,786 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47400, dest: /127.0.0.1:37740, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 89983
2013-10-31 18:35:31,786 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,787 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47682, dest: /127.0.0.1:54365, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 868595
2013-10-31 18:35:31,787 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,788 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50310, dest: /127.0.0.1:34578, bytes: 26757, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8250117222170697749_1180, duration: 1843928
2013-10-31 18:35:31,788 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8250117222170697749_1180 terminating
2013-10-31 18:35:31,790 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,790 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml from client DFSClient_-1596270109
2013-10-31 18:35:31,791 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:35:31,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,792 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8250117222170697749_1180 size 26757
2013-10-31 18:35:31,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=null
2013-10-31 18:35:31,805 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47402, bytes: 26969, op: HDFS_READ, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 396757
2013-10-31 18:35:31,822 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0018: nMaps=4 nReduces=0 max=-1
2013-10-31 18:35:31,823 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0018 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:35:31,823 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0018 RESULT=SUCCESS
2013-10-31 18:35:31,823 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0018
2013-10-31 18:35:31,823 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0018
2013-10-31 18:35:31,823 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0018
2013-10-31 18:35:32,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,161 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml. blk_356557662131998172_1182
2013-10-31 18:35:32,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:47686 dest: /127.0.0.1:54365
2013-10-31 18:35:32,164 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:43513 dest: /127.0.0.1:59471
2013-10-31 18:35:32,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_356557662131998172_1182 src: /127.0.0.1:47405 dest: /127.0.0.1:37740
2013-10-31 18:35:32,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47405, dest: /127.0.0.1:37740, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_356557662131998172_1182, duration: 365490
2013-10-31 18:35:32,172 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43513, dest: /127.0.0.1:59471, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_356557662131998172_1182, duration: 1583262
2013-10-31 18:35:32,174 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,174 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47686, dest: /127.0.0.1:54365, bytes: 26822, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_356557662131998172_1182, duration: 2294764
2013-10-31 18:35:32,174 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_356557662131998172_1182 terminating
2013-10-31 18:35:32,175 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,175 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml from client DFSClient_-1879188964
2013-10-31 18:35:32,175 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_conf.xml is closed by DFSClient_-1879188964
2013-10-31 18:35:32,176 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,176 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_356557662131998172_1182 size 26822
2013-10-31 18:35:32,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:32,186 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken. blk_9214137227429069223_1183
2013-10-31 18:35:32,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:47689 dest: /127.0.0.1:54365
2013-10-31 18:35:32,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:47407 dest: /127.0.0.1:37740
2013-10-31 18:35:32,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9214137227429069223_1183 src: /127.0.0.1:43517 dest: /127.0.0.1:59471
2013-10-31 18:35:32,190 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43517, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 41446
2013-10-31 18:35:32,190 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,190 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,190 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47407, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9214137227429069223_1183, duration: 558166
2013-10-31 18:35:32,191 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,191 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47689, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9214137227429069223_1183, duration: 1113610
2013-10-31 18:35:32,191 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9214137227429069223_1183 terminating
2013-10-31 18:35:32,192 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken from client DFSClient_-1596270109
2013-10-31 18:35:32,192 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:35:32,192 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,195 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9214137227429069223_1183 size 116
2013-10-31 18:35:32,195 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken
2013-10-31 18:35:32,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.splitmetainfo dst=null perm=null
2013-10-31 18:35:32,197 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43518, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4046966012556952094_1179, duration: 117085
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0018 = 1449. Number of splits = 4
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,198 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0018_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0018 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:35:32,199 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0018 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:35:32,819 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data6/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:32,819 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data6/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:32,820 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data6/current/blk_-1767724206513468299
2013-10-31 18:35:32,820 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data5/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:32,820 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data6/current/blk_3023221613854610402
2013-10-31 18:35:32,820 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data5/current/blk_4501709775066199659
2013-10-31 18:35:33,216 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1767724206513468299_1168 file build/test/data/dfs/data/data1/current/blk_-1767724206513468299 for deletion
2013-10-31 18:35:33,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3023221613854610402_1170 file build/test/data/dfs/data/data1/current/blk_3023221613854610402 for deletion
2013-10-31 18:35:33,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1767724206513468299_1168 at file build/test/data/dfs/data/data1/current/blk_-1767724206513468299
2013-10-31 18:35:33,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4501709775066199659_1169 file build/test/data/dfs/data/data2/current/blk_4501709775066199659 for deletion
2013-10-31 18:35:33,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3023221613854610402_1170 at file build/test/data/dfs/data/data1/current/blk_3023221613854610402
2013-10-31 18:35:33,218 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4501709775066199659_1169 at file build/test/data/dfs/data/data2/current/blk_4501709775066199659
2013-10-31 18:35:33,218 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4560125798104689975_1171 file build/test/data/dfs/data/data2/current/blk_4560125798104689975 for deletion
2013-10-31 18:35:33,219 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4560125798104689975_1171 at file build/test/data/dfs/data/data2/current/blk_4560125798104689975
2013-10-31 18:35:34,462 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-5452196635493687275_1177 to datanode(s) 127.0.0.1:34578
2013-10-31 18:35:34,463 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_5683982942081372135_1174
2013-10-31 18:35:34,463 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_-9072667424849248381_1166
2013-10-31 18:35:34,555 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0018_m_000005_0' to tip task_20131031182606197_0018_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:34,564 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:34,565 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000005_0 which needs 1 slots
2013-10-31 18:35:34,565 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000005_0 which needs 1 slots
2013-10-31 18:35:34,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken dst=null perm=null
2013-10-31 18:35:34,774 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47413, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9214137227429069223_1183, duration: 348923
2013-10-31 18:35:34,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=null
2013-10-31 18:35:34,784 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47698, bytes: 26969, op: HDFS_READ, cliID: DFSClient_1414855396, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 376823
2013-10-31 18:35:34,812 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:34,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=null
2013-10-31 18:35:34,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47699, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1414855396, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5452196635493687275_1177, duration: 1533460
2013-10-31 18:35:34,953 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0017_m_-371996203
2013-10-31 18:35:34,960 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25717 with signal TERM. Exit code 0
2013-10-31 18:35:34,960 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_-1961485450
2013-10-31 18:35:34,961 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_-1961485450 spawned.
2013-10-31 18:35:34,963 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000005_0/taskjvm.sh
2013-10-31 18:35:35,044 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:35,045 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:35,045 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:35,045 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_-371996203 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:35,091 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-5452196635493687275_1177 to 127.0.0.1:34578
2013-10-31 18:35:35,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data4/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:35,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data3/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:35,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data4/current/blk_-9072667424849248381
2013-10-31 18:35:35,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data3/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:35,092 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data3/current/blk_-6789407230370558946
2013-10-31 18:35:35,093 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data3/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:35,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5452196635493687275_1177 src: /127.0.0.1:50329 dest: /127.0.0.1:34578
2013-10-31 18:35:35,093 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-5452196635493687275_1177 to /127.0.0.1:34578
2013-10-31 18:35:35,093 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data4/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:35,093 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data3/current/blk_-4627257443058578093
2013-10-31 18:35:35,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data3/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:35,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data3/current/blk_2087420957165246899
2013-10-31 18:35:35,094 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data4/current/blk_8795753558913403673
2013-10-31 18:35:35,095 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data3/current/blk_9090210315426494664
2013-10-31 18:35:35,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5452196635493687275_1177 src: /127.0.0.1:50329 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:35:35,099 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5452196635493687275_1177 size 238055
2013-10-31 18:35:36,116 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_-1961485450 given task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:36,176 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8976559195179578700_1001
2013-10-31 18:35:36,216 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data2/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:36,216 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data2/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:36,216 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data2/current/blk_5683982942081372135
2013-10-31 18:35:36,216 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data1/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:36,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data2/current/blk_8795753558913403673
2013-10-31 18:35:36,217 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data1/current/blk_9090210315426494664
2013-10-31 18:35:36,550 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,551 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0017_m_000004_0 not found in cache
2013-10-31 18:35:36,551 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936551
2013-10-31 18:35:36,551 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936552
2013-10-31 18:35:36,552 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,552 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936552
2013-10-31 18:35:36,592 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_r_-1261202210 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:36,599 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26151 with signal TERM. Exit code 0
2013-10-31 18:35:36,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:36,739 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0017
2013-10-31 18:35:36,740 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0017 for user-log deletion with retainTimeStamp:1383330936740
2013-10-31 18:35:36,751 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:36,751 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:36,751 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:36,751 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_r_-1261202210 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,127 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_204403117 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,139 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25863 with signal TERM. Exit code 0
2013-10-31 18:35:37,309 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,310 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,310 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:37,311 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_204403117 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:35:37,464 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_9090210315426494664_1166 blk_8795753558913403673_1166 blk_-9072667424849248381_1166 blk_5683982942081372135_1174
2013-10-31 18:35:37,464 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4627257443058578093_1166 blk_2087420957165246899_1167 blk_-6789407230370558946_1161 blk_-9072667424849248381_1166 blk_5683982942081372135_1174
2013-10-31 18:35:37,558 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_1734978570 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,566 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25945 with signal TERM. Exit code 0
2013-10-31 18:35:37,660 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_502438488 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,664 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25975 with signal TERM. Exit code 0
2013-10-31 18:35:37,670 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0017_m_-172444087 since job job_20131031182606197_0017 is dead
2013-10-31 18:35:37,674 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group25976 with signal TERM. Exit code 0
2013-10-31 18:35:37,769 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,769 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,769 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:37,770 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_1734978570 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,867 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,868 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,868 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:37,868 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_502438488 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:37,869 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:37,869 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:37,869 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:37,870 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0017_m_-172444087 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:38,007 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 42
2013-10-31 18:35:38,821 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data5/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:38,821 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data6/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:38,821 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data5/current/blk_-9072667424849248381
2013-10-31 18:35:38,821 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data6/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:38,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data6/current/blk_-6789407230370558946
2013-10-31 18:35:38,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data5/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:38,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data6/current/blk_-4627257443058578093
2013-10-31 18:35:38,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data5/current/blk_2087420957165246899
2013-10-31 18:35:38,822 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data6/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:38,823 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data6/current/blk_5683982942081372135
2013-10-31 18:35:39,291 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9072667424849248381_1166 file build/test/data/dfs/data/data8/current/blk_-9072667424849248381 for deletion
2013-10-31 18:35:39,291 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6789407230370558946_1161 file build/test/data/dfs/data/data8/current/blk_-6789407230370558946 for deletion
2013-10-31 18:35:39,291 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9072667424849248381_1166 at file build/test/data/dfs/data/data8/current/blk_-9072667424849248381
2013-10-31 18:35:39,291 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4627257443058578093_1166 file build/test/data/dfs/data/data7/current/blk_-4627257443058578093 for deletion
2013-10-31 18:35:39,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6789407230370558946_1161 at file build/test/data/dfs/data/data8/current/blk_-6789407230370558946
2013-10-31 18:35:39,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4627257443058578093_1166 at file build/test/data/dfs/data/data7/current/blk_-4627257443058578093
2013-10-31 18:35:39,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2087420957165246899_1167 file build/test/data/dfs/data/data7/current/blk_2087420957165246899 for deletion
2013-10-31 18:35:39,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5683982942081372135_1174 file build/test/data/dfs/data/data7/current/blk_5683982942081372135 for deletion
2013-10-31 18:35:39,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2087420957165246899_1167 at file build/test/data/dfs/data/data7/current/blk_2087420957165246899
2013-10-31 18:35:39,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8795753558913403673_1166 file build/test/data/dfs/data/data8/current/blk_8795753558913403673 for deletion
2013-10-31 18:35:39,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5683982942081372135_1174 at file build/test/data/dfs/data/data7/current/blk_5683982942081372135
2013-10-31 18:35:39,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9090210315426494664_1166 file build/test/data/dfs/data/data7/current/blk_9090210315426494664 for deletion
2013-10-31 18:35:39,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8795753558913403673_1166 at file build/test/data/dfs/data/data8/current/blk_8795753558913403673
2013-10-31 18:35:39,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9090210315426494664_1166 at file build/test/data/dfs/data/data7/current/blk_9090210315426494664
2013-10-31 18:35:39,534 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000005_0 0.0% setup
2013-10-31 18:35:39,536 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000005_0 is done.
2013-10-31 18:35:39,536 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000005_0 was -1
2013-10-31 18:35:39,537 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:40,571 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000005_0' has completed task_20131031182606197_0018_m_000005 successfully.
2013-10-31 18:35:40,575 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000000_0' to tip task_20131031182606197_0018_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:40,577 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000000
2013-10-31 18:35:40,579 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:35:40,579 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000001_0' to tip task_20131031182606197_0018_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:35:40,580 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000000_0 which needs 1 slots
2013-10-31 18:35:40,580 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000001
2013-10-31 18:35:40,580 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000000_0 which needs 1 slots
2013-10-31 18:35:40,582 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:35:40,583 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000001_0 which needs 1 slots
2013-10-31 18:35:40,583 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000001_0 which needs 1 slots
2013-10-31 18:35:40,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken dst=null perm=null
2013-10-31 18:35:40,593 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43529, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 310508
2013-10-31 18:35:40,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=null
2013-10-31 18:35:40,603 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47705, bytes: 26969, op: HDFS_READ, cliID: DFSClient_575405771, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8250117222170697749_1180, duration: 395217
2013-10-31 18:35:40,606 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000002_0' to tip task_20131031182606197_0018_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:35:40,606 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000002
2013-10-31 18:35:40,607 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:35:40,608 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000002_0 which needs 1 slots
2013-10-31 18:35:40,608 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000002_0 which needs 1 slots
2013-10-31 18:35:40,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken dst=null perm=null
2013-10-31 18:35:40,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47706, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9214137227429069223_1183, duration: 142017
2013-10-31 18:35:40,613 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_260754084
2013-10-31 18:35:40,614 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_260754084 spawned.
2013-10-31 18:35:40,617 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000000_0/taskjvm.sh
2013-10-31 18:35:40,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=null
2013-10-31 18:35:40,622 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47425, bytes: 26969, op: HDFS_READ, cliID: DFSClient_-847711242, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 404934
2013-10-31 18:35:40,623 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,640 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=null
2013-10-31 18:35:40,649 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47426, bytes: 239915, op: HDFS_READ, cliID: DFSClient_575405771, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5452196635493687275_1177, duration: 604579
2013-10-31 18:35:40,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=null
2013-10-31 18:35:40,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50339, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-847711242, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5452196635493687275_1177, duration: 669880
2013-10-31 18:35:40,705 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1768967875
2013-10-31 18:35:40,705 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1768967875 spawned.
2013-10-31 18:35:40,707 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000001_0/taskjvm.sh
2013-10-31 18:35:40,709 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1504803304
2013-10-31 18:35:40,710 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1504803304 spawned.
2013-10-31 18:35:40,711 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000002_0/taskjvm.sh
2013-10-31 18:35:40,745 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0018_m_000003_0' to tip task_20131031182606197_0018_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:40,746 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0018_m_000003
2013-10-31 18:35:40,747 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:35:40,747 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000003_0 which needs 1 slots
2013-10-31 18:35:40,747 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000003_0 which needs 1 slots
2013-10-31 18:35:40,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018/jobToken dst=null perm=null
2013-10-31 18:35:40,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43537, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9214137227429069223_1183, duration: 303873
2013-10-31 18:35:40,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.xml dst=null perm=null
2013-10-31 18:35:40,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47430, bytes: 26969, op: HDFS_READ, cliID: DFSClient_1098204263, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8250117222170697749_1180, duration: 423643
2013-10-31 18:35:40,781 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:40,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.jar dst=null perm=null
2013-10-31 18:35:40,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43540, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1098204263, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5452196635493687275_1177, duration: 1196068
2013-10-31 18:35:40,900 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_1536261407
2013-10-31 18:35:40,901 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_1536261407 spawned.
2013-10-31 18:35:40,902 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000003_0/taskjvm.sh
2013-10-31 18:35:44,017 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-2544570674502979241_1029
2013-10-31 18:35:45,252 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1768967875 given task: attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,260 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1504803304 given task: attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,264 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_1536261407 given task: attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:45,266 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_260754084 given task: attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:45,580 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:45,580 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0018_m_000005_0
2013-10-31 18:35:45,580 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000005_0 not found in cache
2013-10-31 18:35:45,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=null
2013-10-31 18:35:45,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=null
2013-10-31 18:35:45,755 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50353, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 257096
2013-10-31 18:35:45,758 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43551, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2516087568850634061_1178, duration: 143083
2013-10-31 18:35:45,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=null
2013-10-31 18:35:45,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018/job.split dst=null perm=null
2013-10-31 18:35:45,768 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50355, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2516087568850634061_1178, duration: 108121
2013-10-31 18:35:45,772 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47727, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2516087568850634061_1178, duration: 162620
2013-10-31 18:35:45,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:45,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:45,798 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47728, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 170421
2013-10-31 18:35:45,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:45,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,807 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47446, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 160930
2013-10-31 18:35:45,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:45,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50359, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 105277
2013-10-31 18:35:45,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:45,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:45,943 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47448, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 222713
2013-10-31 18:35:45,947 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001. blk_-3509723217345910061_1187
2013-10-31 18:35:45,950 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002. blk_-8392645727898236769_1187
2013-10-31 18:35:45,959 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003. blk_-2611001242749242842_1187
2013-10-31 18:35:45,962 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000. blk_-7428331401088541696_1187
2013-10-31 18:35:45,970 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:47449 dest: /127.0.0.1:37740
2013-10-31 18:35:45,972 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:47736 dest: /127.0.0.1:54365
2013-10-31 18:35:45,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3509723217345910061_1187 src: /127.0.0.1:43563 dest: /127.0.0.1:59471
2013-10-31 18:35:45,974 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:47733 dest: /127.0.0.1:54365
2013-10-31 18:35:45,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:50367 dest: /127.0.0.1:34578
2013-10-31 18:35:45,975 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8392645727898236769_1187 src: /127.0.0.1:47456 dest: /127.0.0.1:37740
2013-10-31 18:35:45,976 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43563, dest: /127.0.0.1:59471, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3509723217345910061_1187, duration: 1365266
2013-10-31 18:35:45,978 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,980 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47736, dest: /127.0.0.1:54365, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3509723217345910061_1187, duration: 4173743
2013-10-31 18:35:45,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,981 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,981 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47456, dest: /127.0.0.1:37740, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8392645727898236769_1187, duration: 2334177
2013-10-31 18:35:45,981 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,981 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50367, dest: /127.0.0.1:34578, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8392645727898236769_1187, duration: 2931471
2013-10-31 18:35:45,982 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,982 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47449, dest: /127.0.0.1:37740, bytes: 391, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3509723217345910061_1187, duration: 6472174
2013-10-31 18:35:45,983 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,983 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3509723217345910061_1187 terminating
2013-10-31 18:35:45,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47733, dest: /127.0.0.1:54365, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8392645727898236769_1187, duration: 2687281
2013-10-31 18:35:45,984 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8392645727898236769_1187 terminating
2013-10-31 18:35:45,984 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3509723217345910061_1187 size 391
2013-10-31 18:35:45,984 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:50363 dest: /127.0.0.1:34578
2013-10-31 18:35:45,985 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:45,985 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,985 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:47457 dest: /127.0.0.1:37740
2013-10-31 18:35:45,986 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:45,986 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8392645727898236769_1187 size 433
2013-10-31 18:35:45,986 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2611001242749242842_1187 src: /127.0.0.1:43567 dest: /127.0.0.1:59471
2013-10-31 18:35:45,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:47452 dest: /127.0.0.1:37740
2013-10-31 18:35:45,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:50371 dest: /127.0.0.1:34578
2013-10-31 18:35:45,989 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43567, dest: /127.0.0.1:59471, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2611001242749242842_1187, duration: 1538847
2013-10-31 18:35:45,989 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:45,989 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:45,989 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47457, dest: /127.0.0.1:37740, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2611001242749242842_1187, duration: 1878794
2013-10-31 18:35:45,989 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:45,993 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:46,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50363, dest: /127.0.0.1:34578, bytes: 307, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2611001242749242842_1187, duration: 94783756
2013-10-31 18:35:46,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7428331401088541696_1187 src: /127.0.0.1:47743 dest: /127.0.0.1:54365
2013-10-31 18:35:46,082 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2611001242749242842_1187 terminating
2013-10-31 18:35:46,083 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:46,086 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:46,086 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2611001242749242842_1187 size 307
2013-10-31 18:35:46,086 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47743, dest: /127.0.0.1:54365, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7428331401088541696_1187, duration: 1703955
2013-10-31 18:35:46,086 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,086 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50371, dest: /127.0.0.1:34578, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7428331401088541696_1187, duration: 1623641
2013-10-31 18:35:46,087 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,087 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47452, dest: /127.0.0.1:37740, bytes: 319, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0018_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7428331401088541696_1187, duration: 1173195
2013-10-31 18:35:46,087 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7428331401088541696_1187 terminating
2013-10-31 18:35:46,087 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,088 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,088 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7428331401088541696_1187 size 319
2013-10-31 18:35:46,258 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,258 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000001_0 0.0%
2013-10-31 18:35:46,259 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,259 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000002_0 0.0%
2013-10-31 18:35:46,260 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,260 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000000_0 0.0%
2013-10-31 18:35:46,262 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0018_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:35:46,262 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000003_0 0.0%
2013-10-31 18:35:46,585 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000000_0
2013-10-31 18:35:46,588 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000001_0
2013-10-31 18:35:46,613 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000002_0
2013-10-31 18:35:46,753 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0018_m_000003_0
2013-10-31 18:35:47,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0 dst=null perm=null
2013-10-31 18:35:47,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0 dst=null perm=null
2013-10-31 18:35:47,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0 dst=null perm=null
2013-10-31 18:35:47,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0 dst=null perm=null
2013-10-31 18:35:47,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:47,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:47,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000001_0 dst=null perm=null
2013-10-31 18:35:47,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000000_0 dst=null perm=null
2013-10-31 18:35:47,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000002_0 dst=null perm=null
2013-10-31 18:35:47,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary/_attempt_20131031182606197_0018_m_000003_0 dst=null perm=null
2013-10-31 18:35:48,682 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:35:48,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000001_0 is done.
2013-10-31 18:35:48,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000001_0 was -1
2013-10-31 18:35:48,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,687 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:35:48,689 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000002_0 is done.
2013-10-31 18:35:48,689 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000002_0 was -1
2013-10-31 18:35:48,689 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,694 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:35:48,696 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000000_0 is done.
2013-10-31 18:35:48,696 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000000_0 was -1
2013-10-31 18:35:48,696 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:48,697 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:35:48,699 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000003_0 is done.
2013-10-31 18:35:48,699 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000003_0 was -1
2013-10-31 18:35:48,699 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:49,589 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000000_0' has completed task_20131031182606197_0018_m_000000 successfully.
2013-10-31 18:35:49,592 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000001_0' has completed task_20131031182606197_0018_m_000001 successfully.
2013-10-31 18:35:49,617 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000002_0' has completed task_20131031182606197_0018_m_000002 successfully.
2013-10-31 18:35:49,757 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000003_0' has completed task_20131031182606197_0018_m_000003 successfully.
2013-10-31 18:35:49,760 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0018_m_000004_0' to tip task_20131031182606197_0018_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:35:49,763 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0018_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:35:49,763 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0018_m_000004_0 which needs 1 slots
2013-10-31 18:35:49,763 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0018_m_000004_0 which needs 1 slots
2013-10-31 18:35:49,792 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0018_m_646899489
2013-10-31 18:35:49,792 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0018_m_646899489 spawned.
2013-10-31 18:35:49,794 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0018/attempt_20131031182606197_0018_m_000004_0/taskjvm.sh
2013-10-31 18:35:50,672 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0018_m_646899489 given task: attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,210 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000004_0 0.0%
2013-10-31 18:35:51,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary dst=null perm=null
2013-10-31 18:35:51,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:51,229 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS from client DFSClient_attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,229 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0018_m_000004_0
2013-10-31 18:35:51,234 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,234 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,234 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,234 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5452196635493687275 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,234 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2516087568850634061 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4046966012556952094 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:51,235 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8250117222170697749 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:35:51,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0018 dst=null perm=null
2013-10-31 18:35:52,467 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_8250117222170697749_1180 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:52,468 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_8250117222170697749_1180 blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:53,097 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data3/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:53,097 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data4/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:53,098 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data3/current/blk_-5452196635493687275
2013-10-31 18:35:53,098 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data3/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:53,098 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data4/current/blk_2516087568850634061
2013-10-31 18:35:53,098 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data3/current/blk_8250117222170697749
2013-10-31 18:35:54,122 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0018_m_000004_0 0.0% cleanup
2013-10-31 18:35:54,123 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0018_m_000004_0 is done.
2013-10-31 18:35:54,124 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0018_m_000004_0 was -1
2013-10-31 18:35:54,124 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:35:54,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data7/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:54,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data8/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:54,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data7/current/blk_-5452196635493687275
2013-10-31 18:35:54,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data8/current/blk_2516087568850634061
2013-10-31 18:35:54,296 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data7/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:54,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data8/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:54,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data7/current/blk_4046966012556952094
2013-10-31 18:35:54,298 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data8/current/blk_8250117222170697749
2013-10-31 18:35:55,312 WARN namenode.FSNamesystem (PendingReplicationBlocks.java:pendingReplicationCheck(210)) - PendingReplicationMonitor timed out block blk_-2141313976185548712_1012
2013-10-31 18:35:55,468 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_8250117222170697749_1180 blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:55,468 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_4046966012556952094_1179 blk_2516087568850634061_1178 blk_-5452196635493687275_1177
2013-10-31 18:35:55,769 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0018_m_000004_0' has completed task_20131031182606197_0018_m_000004 successfully.
2013-10-31 18:35:55,770 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0018 has completed successfully.
2013-10-31 18:35:55,771 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0018,submitTime=1383244531795,launchTime=1383244532199,firstMapTaskLaunchTime=1383244540575,firstJobSetupTaskLaunchTime=1383244534555,firstJobCleanupTaskLaunchTime=1383244549760,finishTime=1383244555770,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=40,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[DE2FABFEAB294B7BBE737B0CAF0B922E/7D11D1356CE44E77A226D5B8FC3E0762] test/(1/1) ...fieldedpipesplatform/copy
2013-10-31 18:35:55,777 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77. blk_-5440852137687465415_1188
2013-10-31 18:35:55,779 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:47748 dest: /127.0.0.1:54365
2013-10-31 18:35:55,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:47466 dest: /127.0.0.1:37740
2013-10-31 18:35:55,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5440852137687465415_1188 src: /127.0.0.1:50379 dest: /127.0.0.1:34578
2013-10-31 18:35:55,787 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50379, dest: /127.0.0.1:34578, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5440852137687465415_1188, duration: 87838
2013-10-31 18:35:55,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47466, dest: /127.0.0.1:37740, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5440852137687465415_1188, duration: 4457693
2013-10-31 18:35:55,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,792 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47748, dest: /127.0.0.1:54365, bytes: 22691, op: HDFS_WRITE, cliID: DFSClient_-1879188964, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5440852137687465415_1188, duration: 5330890
2013-10-31 18:35:55,792 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5440852137687465415_1188 terminating
2013-10-31 18:35:55,792 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,796 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5440852137687465415_1188 size 22691
2013-10-31 18:35:55,797 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 from client DFSClient_-1879188964
2013-10-31 18:35:55,798 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_logs/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 is closed by DFSClient_-1879188964
2013-10-31 18:35:55,804 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0018_1383244531795_hadoop_%5BDE2FABFEAB294B7BBE737B0CAF0B922E%2F7D11D1356CE44E77 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:55,805 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000003_0'
2013-10-31 18:35:55,805 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000004_0'
2013-10-31 18:35:55,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:35:55,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:35:55,807 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9214137227429069223 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:35:55,811 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/_temporary
2013-10-31 18:35:55,812 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0018_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:35:55,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0018 dst=null perm=null
2013-10-31 18:35:55,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=null
2013-10-31 18:35:55,860 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:35:55,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000 dst=null perm=null
2013-10-31 18:35:55,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001 dst=null perm=null
2013-10-31 18:35:55,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002 dst=null perm=null
2013-10-31 18:35:55,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003 dst=null perm=null
2013-10-31 18:35:55,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000 dst=null perm=null
2013-10-31 18:35:55,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47469, bytes: 323, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7428331401088541696_1187, duration: 279950
2013-10-31 18:35:55,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001 dst=null perm=null
2013-10-31 18:35:55,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47753, bytes: 395, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3509723217345910061_1187, duration: 263227
2013-10-31 18:35:55,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002 dst=null perm=null
2013-10-31 18:35:55,876 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47754, bytes: 437, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8392645727898236769_1187, duration: 284107
2013-10-31 18:35:55,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003 dst=null perm=null
2013-10-31 18:35:55,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47472, bytes: 311, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2611001242749242842_1187, duration: 259895
2013-10-31 18:35:55,879 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/copy
2013-10-31 18:35:55,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy dst=null perm=null
2013-10-31 18:35:55,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00000 dst=null perm=null
2013-10-31 18:35:55,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50385, bytes: 323, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7428331401088541696_1187, duration: 278804
2013-10-31 18:35:55,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00001 dst=null perm=null
2013-10-31 18:35:55,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47474, bytes: 395, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3509723217345910061_1187, duration: 269358
2013-10-31 18:35:55,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00002 dst=null perm=null
2013-10-31 18:35:55,896 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50387, bytes: 437, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8392645727898236769_1187, duration: 267467
2013-10-31 18:35:55,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/copy/part-00003 dst=null perm=null
2013-10-31 18:35:55,901 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43585, bytes: 311, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2611001242749242842_1187, duration: 261766
2013-10-31 18:35:55,923 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:35:55,923 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->['count', 'ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none"]
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:35:55,937 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:35:55,938 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/none
2013-10-31 18:35:55,941 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:35:55,941 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:35:56,007 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:35:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,051 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,065 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,071 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:35:56,071 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:35:56,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:35:56,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:35:56,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,116 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar. blk_-3901584568493252230_1189
2013-10-31 18:35:56,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:50389 dest: /127.0.0.1:34578
2013-10-31 18:35:56,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:43587 dest: /127.0.0.1:59471
2013-10-31 18:35:56,121 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:47762 dest: /127.0.0.1:54365
2013-10-31 18:35:56,129 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47762, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3901584568493252230_1189, duration: 3869414
2013-10-31 18:35:56,129 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,129 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43587, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3901584568493252230_1189, duration: 4947231
2013-10-31 18:35:56,130 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,130 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,130 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50389, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 5673334
2013-10-31 18:35:56,131 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3901584568493252230_1189 terminating
2013-10-31 18:35:56,133 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar from client DFSClient_-1596270109
2013-10-31 18:35:56,134 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:35:56,134 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,135 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:35:56,139 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar. New replication is 10
2013-10-31 18:35:56,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=null
2013-10-31 18:35:56,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,147 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:35:56,153 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:35:56,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:35:56,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,166 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split. New replication is 10
2013-10-31 18:35:56,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=null
2013-10-31 18:35:56,173 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split. blk_-5772430696144033641_1190
2013-10-31 18:35:56,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:50392 dest: /127.0.0.1:34578
2013-10-31 18:35:56,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:43590 dest: /127.0.0.1:59471
2013-10-31 18:35:56,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:47765 dest: /127.0.0.1:54365
2013-10-31 18:35:56,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5772430696144033641_1190 src: /127.0.0.1:47483 dest: /127.0.0.1:37740
2013-10-31 18:35:56,183 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47483, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5772430696144033641_1190, duration: 187214
2013-10-31 18:35:56,183 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,184 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47765, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5772430696144033641_1190, duration: 1055598
2013-10-31 18:35:56,184 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,185 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43590, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 2101529
2013-10-31 18:35:56,185 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,186 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50392, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5772430696144033641_1190, duration: 2899574
2013-10-31 18:35:56,186 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5772430696144033641_1190 terminating
2013-10-31 18:35:56,187 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,188 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split from client DFSClient_-1596270109
2013-10-31 18:35:56,188 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split is closed by DFSClient_-1596270109
2013-10-31 18:35:56,189 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,189 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,190 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5772430696144033641_1190 size 1403
2013-10-31 18:35:56,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,206 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo. blk_-7894420003126651925_1191
2013-10-31 18:35:56,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:43593 dest: /127.0.0.1:59471
2013-10-31 18:35:56,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:47485 dest: /127.0.0.1:37740
2013-10-31 18:35:56,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7894420003126651925_1191 src: /127.0.0.1:50398 dest: /127.0.0.1:34578
2013-10-31 18:35:56,214 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50398, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7894420003126651925_1191, duration: 68673
2013-10-31 18:35:56,214 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,215 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47485, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7894420003126651925_1191, duration: 856177
2013-10-31 18:35:56,215 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,215 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,215 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43593, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7894420003126651925_1191, duration: 1763611
2013-10-31 18:35:56,216 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7894420003126651925_1191 terminating
2013-10-31 18:35:56,221 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,221 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7894420003126651925_1191 size 156
2013-10-31 18:35:56,222 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:35:56,222 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:35:56,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,247 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml. blk_3017248074108405270_1192
2013-10-31 18:35:56,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:47487 dest: /127.0.0.1:37740
2013-10-31 18:35:56,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:47771 dest: /127.0.0.1:54365
2013-10-31 18:35:56,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3017248074108405270_1192 src: /127.0.0.1:50401 dest: /127.0.0.1:34578
2013-10-31 18:35:56,255 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50401, dest: /127.0.0.1:34578, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 67423
2013-10-31 18:35:56,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47771, dest: /127.0.0.1:54365, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 837349
2013-10-31 18:35:56,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,257 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47487, dest: /127.0.0.1:37740, bytes: 28367, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3017248074108405270_1192, duration: 1642469
2013-10-31 18:35:56,257 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3017248074108405270_1192 terminating
2013-10-31 18:35:56,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,261 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3017248074108405270_1192 size 28367
2013-10-31 18:35:56,661 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml from client DFSClient_-1596270109
2013-10-31 18:35:56,661 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:35:56,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=null
2013-10-31 18:35:56,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50403, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-813892404, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 407517
2013-10-31 18:35:56,693 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0019: nMaps=4 nReduces=1 max=-1
2013-10-31 18:35:56,694 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0019 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:35:56,694 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0019
2013-10-31 18:35:56,694 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0019 RESULT=SUCCESS
2013-10-31 18:35:56,694 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0019
2013-10-31 18:35:56,695 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0019
2013-10-31 18:35:56,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data5/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:56,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data6/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:56,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data5/current/blk_-5452196635493687275
2013-10-31 18:35:56,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data5/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:56,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data6/current/blk_2516087568850634061
2013-10-31 18:35:56,828 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data5/current/blk_4046966012556952094
2013-10-31 18:35:56,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,938 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml. blk_3381914167307845159_1194
2013-10-31 18:35:56,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:47492 dest: /127.0.0.1:37740
2013-10-31 18:35:56,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:47776 dest: /127.0.0.1:54365
2013-10-31 18:35:56,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3381914167307845159_1194 src: /127.0.0.1:43603 dest: /127.0.0.1:59471
2013-10-31 18:35:56,948 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43603, dest: /127.0.0.1:59471, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3381914167307845159_1194, duration: 633627
2013-10-31 18:35:56,948 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,949 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47776, dest: /127.0.0.1:54365, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3381914167307845159_1194, duration: 1433059
2013-10-31 18:35:56,949 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,949 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47492, dest: /127.0.0.1:37740, bytes: 28432, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3381914167307845159_1194, duration: 2666302
2013-10-31 18:35:56,950 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3381914167307845159_1194 terminating
2013-10-31 18:35:56,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,952 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml from client DFSClient_-813892404
2013-10-31 18:35:56,952 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_conf.xml is closed by DFSClient_-813892404
2013-10-31 18:35:56,953 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,954 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3381914167307845159_1194 size 28432
2013-10-31 18:35:56,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:35:56,964 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken. blk_8125310525460418873_1195
2013-10-31 18:35:56,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:47778 dest: /127.0.0.1:54365
2013-10-31 18:35:56,967 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:43605 dest: /127.0.0.1:59471
2013-10-31 18:35:56,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8125310525460418873_1195 src: /127.0.0.1:50409 dest: /127.0.0.1:34578
2013-10-31 18:35:56,972 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50409, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8125310525460418873_1195, duration: 94360
2013-10-31 18:35:56,972 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43605, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 869825
2013-10-31 18:35:56,973 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47778, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8125310525460418873_1195, duration: 1830627
2013-10-31 18:35:56,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8125310525460418873_1195 terminating
2013-10-31 18:35:56,977 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken from client DFSClient_-1596270109
2013-10-31 18:35:56,977 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:35:56,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8125310525460418873_1195 size 116
2013-10-31 18:35:56,981 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken
2013-10-31 18:35:56,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.splitmetainfo dst=null perm=null
2013-10-31 18:35:56,985 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50410, bytes: 160, op: HDFS_READ, cliID: DFSClient_-813892404, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7894420003126651925_1191, duration: 287301
2013-10-31 18:35:56,987 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0019 = 1449. Number of splits = 4
2013-10-31 18:35:56,987 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,987 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,987 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0019_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:35:56,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0019 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:35:56,991 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0019 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:35:57,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5452196635493687275_1177 file build/test/data/dfs/data/data1/current/blk_-5452196635493687275 for deletion
2013-10-31 18:35:57,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2516087568850634061_1178 file build/test/data/dfs/data/data2/current/blk_2516087568850634061 for deletion
2013-10-31 18:35:57,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5452196635493687275_1177 at file build/test/data/dfs/data/data1/current/blk_-5452196635493687275
2013-10-31 18:35:57,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2516087568850634061_1178 at file build/test/data/dfs/data/data2/current/blk_2516087568850634061
2013-10-31 18:35:57,224 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4046966012556952094_1179 file build/test/data/dfs/data/data1/current/blk_4046966012556952094 for deletion
2013-10-31 18:35:57,225 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8250117222170697749_1180 file build/test/data/dfs/data/data2/current/blk_8250117222170697749 for deletion
2013-10-31 18:35:57,225 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4046966012556952094_1179 at file build/test/data/dfs/data/data1/current/blk_4046966012556952094
2013-10-31 18:35:57,226 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8250117222170697749_1180 at file build/test/data/dfs/data/data2/current/blk_8250117222170697749
2013-10-31 18:35:58,469 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3901584568493252230_1189 to datanode(s) 127.0.0.1:37740
2013-10-31 18:35:58,470 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_9214137227429069223_1183
2013-10-31 18:35:58,470 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_9214137227429069223_1183
2013-10-31 18:35:58,603 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0019_m_000005_0' to tip task_20131031182606197_0019_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:35:58,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000000_0'
2013-10-31 18:35:58,608 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000005_0'
2013-10-31 18:35:58,610 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000001_0'
2013-10-31 18:35:58,611 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:35:58,612 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000005_0 which needs 1 slots
2013-10-31 18:35:58,612 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000005_0 which needs 1 slots
2013-10-31 18:35:58,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken dst=null perm=null
2013-10-31 18:35:58,620 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50411, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8125310525460418873_1195, duration: 291120
2013-10-31 18:35:58,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=null
2013-10-31 18:35:58,627 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0018_m_000002_0'
2013-10-31 18:35:58,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47784, bytes: 28591, op: HDFS_READ, cliID: DFSClient_145711421, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 389307
2013-10-31 18:35:58,660 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:35:58,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=null
2013-10-31 18:35:58,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47785, bytes: 239915, op: HDFS_READ, cliID: DFSClient_145711421, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3901584568493252230_1189, duration: 1248752
2013-10-31 18:35:58,791 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0018_m_-1961485450
2013-10-31 18:35:58,797 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26365 with signal TERM. Exit code 0
2013-10-31 18:35:58,797 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-570022639
2013-10-31 18:35:58,798 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-570022639 spawned.
2013-10-31 18:35:58,799 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000005_0/taskjvm.sh
2013-10-31 18:35:59,286 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:35:59,286 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:35:59,286 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:35:59,288 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_-1961485450 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:35:59,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data5/current/blk_9214137227429069223 for deletion
2013-10-31 18:35:59,827 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data5/current/blk_9214137227429069223
2013-10-31 18:36:00,094 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-570022639 given task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:00,224 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3901584568493252230_1189 to 127.0.0.1:37740
2013-10-31 18:36:00,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3901584568493252230_1189 src: /127.0.0.1:47504 dest: /127.0.0.1:37740
2013-10-31 18:36:00,225 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3901584568493252230_1189 to /127.0.0.1:37740
2013-10-31 18:36:00,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3901584568493252230_1189 src: /127.0.0.1:47504 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:36:00,229 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3901584568493252230_1189 size 238055
2013-10-31 18:36:00,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data8/current/blk_9214137227429069223 for deletion
2013-10-31 18:36:00,297 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data8/current/blk_9214137227429069223
2013-10-31 18:36:00,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:00,805 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:00,806 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000004_0 not found in cache
2013-10-31 18:36:00,806 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000003_0 not found in cache
2013-10-31 18:36:00,807 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330960807
2013-10-31 18:36:01,263 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1536261407 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:01,274 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26566 with signal TERM. Exit code 0
2013-10-31 18:36:01,471 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_9214137227429069223_1183
2013-10-31 18:36:01,483 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:01,484 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:01,484 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:01,484 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1536261407 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:02,099 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9214137227429069223_1183 file build/test/data/dfs/data/data3/current/blk_9214137227429069223 for deletion
2013-10-31 18:36:02,099 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9214137227429069223_1183 at file build/test/data/dfs/data/data3/current/blk_9214137227429069223
2013-10-31 18:36:02,189 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_646899489 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:02,197 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26833 with signal TERM. Exit code 0
2013-10-31 18:36:02,360 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:02,360 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:02,360 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:02,361 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_646899489 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:03,524 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000005_0 0.0% setup
2013-10-31 18:36:03,527 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000005_0 is done.
2013-10-31 18:36:03,528 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000005_0 was -1
2013-10-31 18:36:03,528 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:03,612 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,612 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,612 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000001_0 not found in cache
2013-10-31 18:36:03,612 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000000_0 not found in cache
2013-10-31 18:36:03,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963613
2013-10-31 18:36:03,613 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963613
2013-10-31 18:36:03,628 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0018
2013-10-31 18:36:03,629 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0018_m_000002_0 not found in cache
2013-10-31 18:36:03,629 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0018 for user-log deletion with retainTimeStamp:1383330963629
2013-10-31 18:36:04,249 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1768967875 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,252 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_1504803304 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,259 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26567 with signal TERM. Exit code 0
2013-10-31 18:36:04,262 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26565 with signal TERM. Exit code 0
2013-10-31 18:36:04,264 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0018_m_260754084 since job job_20131031182606197_0018 is dead
2013-10-31 18:36:04,273 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26568 with signal TERM. Exit code 0
2013-10-31 18:36:04,464 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,465 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,465 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:04,465 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1504803304 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,466 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,466 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,466 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:04,467 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_260754084 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,617 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000005_0' has completed task_20131031182606197_0019_m_000005 successfully.
2013-10-31 18:36:04,620 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000000_0' to tip task_20131031182606197_0019_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:04,621 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000000
2013-10-31 18:36:04,624 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000001_0' to tip task_20131031182606197_0019_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:36:04,624 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:04,624 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000001
2013-10-31 18:36:04,624 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000000_0 which needs 1 slots
2013-10-31 18:36:04,624 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000000_0 which needs 1 slots
2013-10-31 18:36:04,625 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:04,625 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:04,625 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:04,625 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0018_m_1768967875 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:04,625 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:36:04,626 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000001_0 which needs 1 slots
2013-10-31 18:36:04,627 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000001_0 which needs 1 slots
2013-10-31 18:36:04,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken dst=null perm=null
2013-10-31 18:36:04,632 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43615, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 148052
2013-10-31 18:36:04,634 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000002_0' to tip task_20131031182606197_0019_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:36:04,635 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000002
2013-10-31 18:36:04,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=null
2013-10-31 18:36:04,636 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:36:04,636 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000002_0 which needs 1 slots
2013-10-31 18:36:04,636 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000002_0 which needs 1 slots
2013-10-31 18:36:04,637 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47508, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-68063591, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3017248074108405270_1192, duration: 177898
2013-10-31 18:36:04,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken dst=null perm=null
2013-10-31 18:36:04,641 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47792, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8125310525460418873_1195, duration: 308124
2013-10-31 18:36:04,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=null
2013-10-31 18:36:04,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50423, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-2136551949, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3017248074108405270_1192, duration: 538340
2013-10-31 18:36:04,657 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,661 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,665 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_1949184114
2013-10-31 18:36:04,666 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_1949184114 spawned.
2013-10-31 18:36:04,667 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000000_0/taskjvm.sh
2013-10-31 18:36:04,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=null
2013-10-31 18:36:04,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=null
2013-10-31 18:36:04,677 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50424, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-68063591, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 641758
2013-10-31 18:36:04,677 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43622, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2136551949, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3901584568493252230_1189, duration: 644852
2013-10-31 18:36:04,781 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-1043381516
2013-10-31 18:36:04,781 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_112423469
2013-10-31 18:36:04,782 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-1043381516 spawned.
2013-10-31 18:36:04,783 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_112423469 spawned.
2013-10-31 18:36:04,786 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000002_0/taskjvm.sh
2013-10-31 18:36:04,786 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000001_0/taskjvm.sh
2013-10-31 18:36:04,815 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0019_m_000003_0' to tip task_20131031182606197_0019_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:36:04,815 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0019_m_000003
2013-10-31 18:36:04,817 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:36:04,818 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000003_0 which needs 1 slots
2013-10-31 18:36:04,818 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000003_0 which needs 1 slots
2013-10-31 18:36:04,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019/jobToken dst=null perm=null
2013-10-31 18:36:04,827 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43623, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8125310525460418873_1195, duration: 290308
2013-10-31 18:36:04,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.xml dst=null perm=null
2013-10-31 18:36:04,837 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47799, bytes: 28591, op: HDFS_READ, cliID: DFSClient_-587080131, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3017248074108405270_1192, duration: 383697
2013-10-31 18:36:04,867 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:04,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.jar dst=null perm=null
2013-10-31 18:36:04,889 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50429, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-587080131, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3901584568493252230_1189, duration: 599154
2013-10-31 18:36:05,615 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_1949184114 given task: attempt_20131031182606197_0019_m_000000_0
2013-10-31 18:36:06,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=null
2013-10-31 18:36:06,138 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50432, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5772430696144033641_1190, duration: 166222
2013-10-31 18:36:06,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:06,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50433, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 256752
2013-10-31 18:36:06,400 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4435351282615346343_1046
2013-10-31 18:36:06,418 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_m_-2097867249
2013-10-31 18:36:06,420 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_m_-2097867249 spawned.
2013-10-31 18:36:06,422 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_m_000003_0/taskjvm.sh
2013-10-31 18:36:07,134 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0019_m_000000_0 is 2512 ms debug.
2013-10-31 18:36:07,218 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-1043381516 given task: attempt_20131031182606197_0019_m_000002_0
2013-10-31 18:36:07,229 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_112423469 given task: attempt_20131031182606197_0019_m_000001_0
2013-10-31 18:36:07,395 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_-2097867249 given task: attempt_20131031182606197_0019_m_000003_0
2013-10-31 18:36:07,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=null
2013-10-31 18:36:07,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43636, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 174016
2013-10-31 18:36:07,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=null
2013-10-31 18:36:07,722 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47811, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5772430696144033641_1190, duration: 143003
2013-10-31 18:36:07,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:07,752 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47529, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 144634
2013-10-31 18:36:07,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:07,893 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:36:07,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019/job.split dst=null perm=null
2013-10-31 18:36:07,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43640, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5772430696144033641_1190, duration: 123898
2013-10-31 18:36:07,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:07,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50444, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 158283
2013-10-31 18:36:08,018 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47816, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0019_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 189351
2013-10-31 18:36:09,047 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:36:09,050 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000000_0 is done.
2013-10-31 18:36:09,050 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000000_0 was 62
2013-10-31 18:36:09,050 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:09,624 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:09,625 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0019_m_000005_0
2013-10-31 18:36:09,625 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0019_m_000005_0 not found in cache
2013-10-31 18:36:10,629 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000000_0' has completed task_20131031182606197_0019_m_000000 successfully.
2013-10-31 18:36:10,631 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0019_r_000000_0' to tip task_20131031182606197_0019_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:10,633 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:10,634 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_r_000000_0 which needs 1 slots
2013-10-31 18:36:10,634 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_r_000000_0 which needs 1 slots
2013-10-31 18:36:10,657 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:36:10,661 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000002_0 is done.
2013-10-31 18:36:10,661 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000002_0 was 85
2013-10-31 18:36:10,662 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:10,662 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:36:10,667 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000001_0 is done.
2013-10-31 18:36:10,667 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000001_0 was 83
2013-10-31 18:36:10,669 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:10,691 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0019_r_-1747545474
2013-10-31 18:36:10,691 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0019_r_-1747545474 spawned.
2013-10-31 18:36:10,694 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0019/attempt_20131031182606197_0019_r_000000_0/taskjvm.sh
2013-10-31 18:36:10,826 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:36:10,829 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000003_0 is done.
2013-10-31 18:36:10,829 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000003_0 was 61
2013-10-31 18:36:10,829 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:11,774 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_r_-1747545474 given task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:13,637 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000001_0' has completed task_20131031182606197_0019_m_000001 successfully.
2013-10-31 18:36:13,662 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000002_0' has completed task_20131031182606197_0019_m_000002 successfully.
2013-10-31 18:36:13,824 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000003_0' has completed task_20131031182606197_0019_m_000003 successfully.
2013-10-31 18:36:17,437 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44528, bytes: 62, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000000_0, duration: 6238920
2013-10-31 18:36:17,453 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39832, bytes: 83, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000001_0, duration: 10369030
2013-10-31 18:36:17,469 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49488, bytes: 85, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000002_0, duration: 11446221
2013-10-31 18:36:17,486 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41855, bytes: 61, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0019_m_000003_0, duration: 12092711
2013-10-31 18:36:18,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,299 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,357 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:18,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:18,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:18,594 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000. blk_-8039349918214939140_1196
2013-10-31 18:36:18,626 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:43651 dest: /127.0.0.1:59471
2013-10-31 18:36:18,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:47826 dest: /127.0.0.1:54365
2013-10-31 18:36:18,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8039349918214939140_1196 src: /127.0.0.1:47544 dest: /127.0.0.1:37740
2013-10-31 18:36:18,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47544, dest: /127.0.0.1:37740, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8039349918214939140_1196, duration: 1691475
2013-10-31 18:36:18,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,631 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47826, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8039349918214939140_1196, duration: 2638767
2013-10-31 18:36:18,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,632 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43651, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0019_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8039349918214939140_1196, duration: 3104677
2013-10-31 18:36:18,632 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8039349918214939140_1196 terminating
2013-10-31 18:36:18,634 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,635 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:18,635 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:18,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,636 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8039349918214939140_1196 size 128
2013-10-31 18:36:18,670 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0019_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:36:18,670 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:19,643 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0019_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:36:19,644 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:19,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0 dst=null perm=null
2013-10-31 18:36:19,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:19,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:19,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary/_attempt_20131031182606197_0019_r_000000_0 dst=null perm=null
2013-10-31 18:36:21,301 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:21,302 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:21,303 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_r_000000_0 is done.
2013-10-31 18:36:21,303 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_r_000000_0 was -1
2013-10-31 18:36:21,304 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:22,648 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_r_000000_0' has completed task_20131031182606197_0019_r_000000 successfully.
2013-10-31 18:36:22,653 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0019_m_000004_0' to tip task_20131031182606197_0019_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:22,655 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0019_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:36:22,655 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0019_m_000004_0 which needs 1 slots
2013-10-31 18:36:22,656 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0019_m_000004_0 which needs 1 slots
2013-10-31 18:36:22,689 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0019/attempt_20131031182606197_0019_m_000004_0. Attempting to reuse: jvm_20131031182606197_0019_m_1949184114
2013-10-31 18:36:23,130 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0019_m_1949184114 given task: attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,264 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000004_0 0.0%
2013-10-31 18:36:23,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary dst=null perm=null
2013-10-31 18:36:23,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:23,279 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS from client DFSClient_attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,279 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0019_m_000004_0
2013-10-31 18:36:23,283 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,283 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,283 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,283 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3901584568493252230 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5772430696144033641 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,284 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:23,285 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7894420003126651925 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,285 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:23,285 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:23,285 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3017248074108405270 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:23,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0019 dst=null perm=null
2013-10-31 18:36:25,475 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190
2013-10-31 18:36:25,475 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:26,215 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0019_m_000004_0 0.0% cleanup
2013-10-31 18:36:26,217 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0019_m_000004_0 is done.
2013-10-31 18:36:26,217 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0019_m_000004_0 was -1
2013-10-31 18:36:26,217 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data6/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data5/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data6/current/blk_-7894420003126651925
2013-10-31 18:36:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data6/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:26,837 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data5/current/blk_-5772430696144033641
2013-10-31 18:36:26,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data6/current/blk_-3901584568493252230
2013-10-31 18:36:27,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data7/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:27,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data8/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:27,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data7/current/blk_-7894420003126651925
2013-10-31 18:36:27,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data8/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:27,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data8/current/blk_-5772430696144033641
2013-10-31 18:36:27,308 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data8/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:27,308 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data8/current/blk_-3901584568493252230
2013-10-31 18:36:27,309 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data8/current/blk_3017248074108405270
2013-10-31 18:36:27,656 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:27,656 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0019_r_000000_0
2013-10-31 18:36:28,476 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-3901584568493252230_1189 blk_-7894420003126651925_1191 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:28,476 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3901584568493252230_1189 blk_-5772430696144033641_1190 blk_3017248074108405270_1192
2013-10-31 18:36:28,663 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0019_m_000004_0' has completed task_20131031182606197_0019_m_000004 successfully.
2013-10-31 18:36:28,664 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0019 has completed successfully.
2013-10-31 18:36:28,664 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0019,submitTime=1383244556666,launchTime=1383244556990,firstMapTaskLaunchTime=1383244564620,firstReduceTaskLaunchTime=1383244570631,firstJobSetupTaskLaunchTime=1383244558603,firstJobCleanupTaskLaunchTime=1383244582652,finishTime=1383244588664,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[BED69F8FF7F34812A12665BA81CD7B25/BF10BB85030C48EDBB8D74F68D5A2154] test/(1/1) ...fieldedpipesplatform/none
2013-10-31 18:36:28,670 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED. blk_6752359892383718101_1197
2013-10-31 18:36:28,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:43656 dest: /127.0.0.1:59471
2013-10-31 18:36:28,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:47831 dest: /127.0.0.1:54365
2013-10-31 18:36:28,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6752359892383718101_1197 src: /127.0.0.1:47549 dest: /127.0.0.1:37740
2013-10-31 18:36:28,686 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47549, dest: /127.0.0.1:37740, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6752359892383718101_1197, duration: 2359466
2013-10-31 18:36:28,687 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,687 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47831, dest: /127.0.0.1:54365, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6752359892383718101_1197, duration: 3821832
2013-10-31 18:36:28,688 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43656, dest: /127.0.0.1:59471, bytes: 28304, op: HDFS_WRITE, cliID: DFSClient_-813892404, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6752359892383718101_1197, duration: 4960328
2013-10-31 18:36:28,689 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6752359892383718101_1197 terminating
2013-10-31 18:36:28,692 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED from client DFSClient_-813892404
2013-10-31 18:36:28,692 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_logs/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED is closed by DFSClient_-813892404
2013-10-31 18:36:28,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6752359892383718101_1197 size 28304
2013-10-31 18:36:28,705 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0019_1383244556666_hadoop_%5BBED69F8FF7F34812A12665BA81CD7B25%2FBF10BB85030C48ED to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:36:28,706 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000000_0'
2013-10-31 18:36:28,706 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000004_0'
2013-10-31 18:36:28,710 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:28,710 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000005_0'
2013-10-31 18:36:28,710 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:28,710 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_r_000000_0'
2013-10-31 18:36:28,711 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8125310525460418873 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:28,711 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000002_0'
2013-10-31 18:36:28,712 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000001_0'
2013-10-31 18:36:28,714 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0019_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:36:28,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0019 dst=null perm=null
2013-10-31 18:36:28,719 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/_temporary
2013-10-31 18:36:28,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none dst=null perm=null
2013-10-31 18:36:28,739 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:36:28,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000 dst=null perm=null
2013-10-31 18:36:28,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000 dst=null perm=null
2013-10-31 18:36:28,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47834, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8039349918214939140_1196, duration: 287588
2013-10-31 18:36:28,745 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/none
2013-10-31 18:36:28,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none dst=null perm=null
2013-10-31 18:36:28,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/none/part-00000 dst=null perm=null
2013-10-31 18:36:28,751 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47552, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8039349918214939140_1196, duration: 316407
2013-10-31 18:36:28,758 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:36:28,759 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:36:28,770 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:36:28,771 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:36:28,771 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->['count', 'ipaddress']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap"]
2013-10-31 18:36:28,772 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:36:28,772 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:36:28,772 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:36:28,775 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...fieldedpipesplatform/swap
2013-10-31 18:36:28,777 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:36:28,777 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:36:28,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:28,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:36:28,841 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0019_m_000003_0'
2013-10-31 18:36:28,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,939 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar. blk_-2889835826154294416_1198
2013-10-31 18:36:28,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:47836 dest: /127.0.0.1:54365
2013-10-31 18:36:28,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:43663 dest: /127.0.0.1:59471
2013-10-31 18:36:28,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:50467 dest: /127.0.0.1:34578
2013-10-31 18:36:28,954 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50467, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 6606640
2013-10-31 18:36:28,955 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,955 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43663, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2889835826154294416_1198, duration: 7827708
2013-10-31 18:36:28,956 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,956 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,956 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47836, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2889835826154294416_1198, duration: 8495425
2013-10-31 18:36:28,957 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2889835826154294416_1198 terminating
2013-10-31 18:36:28,959 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,959 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar from client DFSClient_-1596270109
2013-10-31 18:36:28,960 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:36:28,960 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:28,964 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar. New replication is 10
2013-10-31 18:36:28,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=null
2013-10-31 18:36:28,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,974 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:36:28,979 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:36:28,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:28,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:28,994 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split. New replication is 10
2013-10-31 18:36:28,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=null
2013-10-31 18:36:29,001 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split. blk_-7715455870848698122_1199
2013-10-31 18:36:29,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:50468 dest: /127.0.0.1:34578
2013-10-31 18:36:29,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:47840 dest: /127.0.0.1:54365
2013-10-31 18:36:29,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:43667 dest: /127.0.0.1:59471
2013-10-31 18:36:29,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7715455870848698122_1199 src: /127.0.0.1:47559 dest: /127.0.0.1:37740
2013-10-31 18:36:29,010 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47559, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7715455870848698122_1199, duration: 115424
2013-10-31 18:36:29,011 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,011 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43667, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7715455870848698122_1199, duration: 971127
2013-10-31 18:36:29,012 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,012 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47840, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7715455870848698122_1199, duration: 1870526
2013-10-31 18:36:29,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50468, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 2684174
2013-10-31 18:36:29,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7715455870848698122_1199 terminating
2013-10-31 18:36:29,016 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,016 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split from client DFSClient_-1596270109
2013-10-31 18:36:29,017 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split is closed by DFSClient_-1596270109
2013-10-31 18:36:29,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7715455870848698122_1199 size 1403
2013-10-31 18:36:29,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,036 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo. blk_-7275852970796318644_1200
2013-10-31 18:36:29,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:43669 dest: /127.0.0.1:59471
2013-10-31 18:36:29,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:50473 dest: /127.0.0.1:34578
2013-10-31 18:36:29,040 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7275852970796318644_1200 src: /127.0.0.1:47845 dest: /127.0.0.1:54365
2013-10-31 18:36:29,043 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47845, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7275852970796318644_1200, duration: 88292
2013-10-31 18:36:29,044 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50473, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7275852970796318644_1200, duration: 918844
2013-10-31 18:36:29,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43669, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7275852970796318644_1200, duration: 1746171
2013-10-31 18:36:29,046 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7275852970796318644_1200 terminating
2013-10-31 18:36:29,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,049 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:36:29,050 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:36:29,050 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7275852970796318644_1200 size 156
2013-10-31 18:36:29,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,071 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml. blk_-1742899109407851518_1201
2013-10-31 18:36:29,073 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:43672 dest: /127.0.0.1:59471
2013-10-31 18:36:29,074 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:50476 dest: /127.0.0.1:34578
2013-10-31 18:36:29,076 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1742899109407851518_1201 src: /127.0.0.1:47565 dest: /127.0.0.1:37740
2013-10-31 18:36:29,079 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47565, dest: /127.0.0.1:37740, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 331354
2013-10-31 18:36:29,079 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,079 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50476, dest: /127.0.0.1:34578, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1742899109407851518_1201, duration: 1213721
2013-10-31 18:36:29,080 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,080 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,080 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43672, dest: /127.0.0.1:59471, bytes: 28159, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1742899109407851518_1201, duration: 2114201
2013-10-31 18:36:29,080 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,081 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1742899109407851518_1201 terminating
2013-10-31 18:36:29,082 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1742899109407851518_1201 size 28159
2013-10-31 18:36:29,083 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml from client DFSClient_-1596270109
2013-10-31 18:36:29,083 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:36:29,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=null
2013-10-31 18:36:29,098 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47567, bytes: 28379, op: HDFS_READ, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 409408
2013-10-31 18:36:29,116 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0020: nMaps=4 nReduces=1 max=-1
2013-10-31 18:36:29,116 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0020 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:36:29,116 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0020
2013-10-31 18:36:29,117 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0020 RESULT=SUCCESS
2013-10-31 18:36:29,117 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0020
2013-10-31 18:36:29,118 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0020
2013-10-31 18:36:29,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,147 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data3/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:29,147 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data4/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:29,147 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data3/current/blk_-5772430696144033641
2013-10-31 18:36:29,148 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data4/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:29,148 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data4/current/blk_-3901584568493252230
2013-10-31 18:36:29,148 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data4/current/blk_3017248074108405270
2013-10-31 18:36:29,150 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml. blk_1218262851856022493_1203
2013-10-31 18:36:29,152 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:47568 dest: /127.0.0.1:37740
2013-10-31 18:36:29,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:47852 dest: /127.0.0.1:54365
2013-10-31 18:36:29,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1218262851856022493_1203 src: /127.0.0.1:50482 dest: /127.0.0.1:34578
2013-10-31 18:36:29,159 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50482, dest: /127.0.0.1:34578, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1218262851856022493_1203, duration: 557765
2013-10-31 18:36:29,160 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,160 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,160 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47852, dest: /127.0.0.1:54365, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1218262851856022493_1203, duration: 1488872
2013-10-31 18:36:29,161 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,161 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47568, dest: /127.0.0.1:37740, bytes: 28224, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1218262851856022493_1203, duration: 2537572
2013-10-31 18:36:29,162 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1218262851856022493_1203 terminating
2013-10-31 18:36:29,164 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml from client DFSClient_-791702297
2013-10-31 18:36:29,164 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_conf.xml is closed by DFSClient_-791702297
2013-10-31 18:36:29,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,166 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1218262851856022493_1203 size 28224
2013-10-31 18:36:29,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:29,793 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken. blk_2967099774717268511_1204
2013-10-31 18:36:29,795 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:47571 dest: /127.0.0.1:37740
2013-10-31 18:36:29,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:43681 dest: /127.0.0.1:59471
2013-10-31 18:36:29,798 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2967099774717268511_1204 src: /127.0.0.1:50485 dest: /127.0.0.1:34578
2013-10-31 18:36:29,801 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50485, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 70496
2013-10-31 18:36:29,802 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,802 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,802 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43681, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 920126
2013-10-31 18:36:29,803 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,803 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47571, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2967099774717268511_1204, duration: 2033647
2013-10-31 18:36:29,804 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2967099774717268511_1204 terminating
2013-10-31 18:36:29,806 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,806 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken from client DFSClient_-1596270109
2013-10-31 18:36:29,807 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:36:29,807 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2967099774717268511_1204 size 116
2013-10-31 18:36:29,811 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken
2013-10-31 18:36:29,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.splitmetainfo dst=null perm=null
2013-10-31 18:36:29,815 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43683, bytes: 160, op: HDFS_READ, cliID: DFSClient_-791702297, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7275852970796318644_1200, duration: 274678
2013-10-31 18:36:29,816 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0020 = 1449. Number of splits = 4
2013-10-31 18:36:29,816 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,817 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,818 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0020_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:36:29,819 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0020 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:36:29,820 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0020 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:36:30,234 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7894420003126651925_1191 file build/test/data/dfs/data/data2/current/blk_-7894420003126651925 for deletion
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5772430696144033641_1190 file build/test/data/dfs/data/data1/current/blk_-5772430696144033641 for deletion
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3901584568493252230_1189 file build/test/data/dfs/data/data2/current/blk_-3901584568493252230 for deletion
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7894420003126651925_1191 at file build/test/data/dfs/data/data2/current/blk_-7894420003126651925
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5772430696144033641_1190 at file build/test/data/dfs/data/data1/current/blk_-5772430696144033641
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3017248074108405270_1192 file build/test/data/dfs/data/data1/current/blk_3017248074108405270 for deletion
2013-10-31 18:36:30,235 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3901584568493252230_1189 at file build/test/data/dfs/data/data2/current/blk_-3901584568493252230
2013-10-31 18:36:30,236 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3017248074108405270_1192 at file build/test/data/dfs/data/data1/current/blk_3017248074108405270
2013-10-31 18:36:31,477 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-2889835826154294416_1198 to datanode(s) 127.0.0.1:37740
2013-10-31 18:36:31,477 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_8125310525460418873_1195
2013-10-31 18:36:31,478 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_8125310525460418873_1195
2013-10-31 18:36:31,718 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0020_m_000005_0' to tip task_20131031182606197_0020_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:31,729 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:36:31,729 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000005_0 which needs 1 slots
2013-10-31 18:36:31,729 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000005_0 which needs 1 slots
2013-10-31 18:36:31,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken dst=null perm=null
2013-10-31 18:36:31,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43684, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 315293
2013-10-31 18:36:31,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=null
2013-10-31 18:36:31,748 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50489, bytes: 28379, op: HDFS_READ, cliID: DFSClient_28430789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1742899109407851518_1201, duration: 389213
2013-10-31 18:36:31,775 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:31,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=null
2013-10-31 18:36:31,808 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50490, bytes: 239915, op: HDFS_READ, cliID: DFSClient_28430789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 1424286
2013-10-31 18:36:31,902 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0019_m_-570022639
2013-10-31 18:36:31,909 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group26994 with signal TERM. Exit code 0
2013-10-31 18:36:31,910 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-1374561285
2013-10-31 18:36:31,911 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-1374561285 spawned.
2013-10-31 18:36:31,912 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000005_0/taskjvm.sh
2013-10-31 18:36:32,433 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:32,433 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:32,433 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:32,434 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-570022639 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:32,838 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-2889835826154294416_1198 to 127.0.0.1:37740
2013-10-31 18:36:32,838 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data6/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:32,839 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data6/current/blk_8125310525460418873
2013-10-31 18:36:32,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2889835826154294416_1198 src: /127.0.0.1:47579 dest: /127.0.0.1:37740
2013-10-31 18:36:32,839 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-2889835826154294416_1198 to /127.0.0.1:37740
2013-10-31 18:36:32,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2889835826154294416_1198 src: /127.0.0.1:47579 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:36:32,841 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2889835826154294416_1198 size 238055
2013-10-31 18:36:33,237 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data2/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:33,237 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data2/current/blk_8125310525460418873
2013-10-31 18:36:33,252 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1374561285 given task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:33,712 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,712 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0019_m_000004_0 not found in cache
2013-10-31 18:36:33,712 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,713 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,713 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993713
2013-10-31 18:36:33,759 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1073 Total time for transactions(ms): 25Number of transactions batched in Syncs: 98 Number of syncs: 739 SyncTimes(ms): 60872 13455
2013-10-31 18:36:33,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:33,842 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0019
2013-10-31 18:36:33,842 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0019 for user-log deletion with retainTimeStamp:1383330993842
2013-10-31 18:36:33,843 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_r_-1747545474 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,853 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27444 with signal TERM. Exit code 0
2013-10-31 18:36:33,897 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_112423469 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,902 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27255 with signal TERM. Exit code 0
2013-10-31 18:36:33,917 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_-1043381516 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,921 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27256 with signal TERM. Exit code 0
2013-10-31 18:36:33,954 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_-2097867249 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:33,960 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27326 with signal TERM. Exit code 0
2013-10-31 18:36:34,022 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,022 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,022 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:34,022 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_r_-1747545474 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,115 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,115 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,115 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:34,115 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_112423469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,123 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,124 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,124 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:34,124 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-1043381516 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,188 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,188 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,188 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:34,188 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_-2097867249 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:36:34,253 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0019_m_1949184114 since job job_20131031182606197_0019 is dead
2013-10-31 18:36:34,263 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27176 with signal TERM. Exit code 0
2013-10-31 18:36:34,447 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:36:34,447 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:36:34,447 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:36:34,447 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0019_m_1949184114 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:36:34,479 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_8125310525460418873_1195
2013-10-31 18:36:35,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8125310525460418873_1195 file build/test/data/dfs/data/data4/current/blk_8125310525460418873 for deletion
2013-10-31 18:36:35,111 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8125310525460418873_1195 at file build/test/data/dfs/data/data4/current/blk_8125310525460418873
2013-10-31 18:36:36,683 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000005_0 0.0% setup
2013-10-31 18:36:36,686 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000005_0 is done.
2013-10-31 18:36:36,686 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000005_0 was -1
2013-10-31 18:36:36,686 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:37,735 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000005_0' has completed task_20131031182606197_0020_m_000005 successfully.
2013-10-31 18:36:37,740 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000000_0' to tip task_20131031182606197_0020_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:37,743 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000000
2013-10-31 18:36:37,746 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000001_0' to tip task_20131031182606197_0020_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:36:37,748 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:37,749 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000001
2013-10-31 18:36:37,749 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000000_0 which needs 1 slots
2013-10-31 18:36:37,749 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000000_0 which needs 1 slots
2013-10-31 18:36:37,751 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:36:37,752 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000001_0 which needs 1 slots
2013-10-31 18:36:37,752 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000001_0 which needs 1 slots
2013-10-31 18:36:37,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken dst=null perm=null
2013-10-31 18:36:37,761 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43694, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2967099774717268511_1204, duration: 319098
2013-10-31 18:36:37,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=null
2013-10-31 18:36:37,772 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000002_0' to tip task_20131031182606197_0020_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:36:37,773 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000002
2013-10-31 18:36:37,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47587, bytes: 28379, op: HDFS_READ, cliID: DFSClient_547673069, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 397874
2013-10-31 18:36:37,775 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:36:37,775 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000002_0 which needs 1 slots
2013-10-31 18:36:37,776 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000002_0 which needs 1 slots
2013-10-31 18:36:37,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken dst=null perm=null
2013-10-31 18:36:37,784 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50500, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 436210
2013-10-31 18:36:37,788 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_394041626
2013-10-31 18:36:37,789 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_394041626 spawned.
2013-10-31 18:36:37,790 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000000_0/taskjvm.sh
2013-10-31 18:36:37,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=null
2013-10-31 18:36:37,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47590, bytes: 28379, op: HDFS_READ, cliID: DFSClient_-840794698, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 187903
2013-10-31 18:36:37,800 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,826 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,849 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0020_m_000003_0' to tip task_20131031182606197_0020_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:36:37,850 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0020_m_000003
2013-10-31 18:36:37,852 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:36:37,852 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000003_0 which needs 1 slots
2013-10-31 18:36:37,852 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000003_0 which needs 1 slots
2013-10-31 18:36:37,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020/jobToken dst=null perm=null
2013-10-31 18:36:37,921 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50503, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2967099774717268511_1204, duration: 306451
2013-10-31 18:36:37,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=null
2013-10-31 18:36:37,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.xml dst=null perm=null
2013-10-31 18:36:37,931 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47593, bytes: 239915, op: HDFS_READ, cliID: DFSClient_547673069, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2889835826154294416_1198, duration: 1572814
2013-10-31 18:36:37,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47594, bytes: 28379, op: HDFS_READ, cliID: DFSClient_1666280287, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1742899109407851518_1201, duration: 423299
2013-10-31 18:36:37,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=null
2013-10-31 18:36:37,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50507, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-840794698, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2889835826154294416_1198, duration: 1631607
2013-10-31 18:36:37,962 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:36:37,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.jar dst=null perm=null
2013-10-31 18:36:37,977 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47596, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1666280287, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2889835826154294416_1198, duration: 645237
2013-10-31 18:36:38,012 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-873425933
2013-10-31 18:36:38,013 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-873425933 spawned.
2013-10-31 18:36:38,015 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000001_0/taskjvm.sh
2013-10-31 18:36:38,023 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-614092363
2013-10-31 18:36:38,023 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-614092363 spawned.
2013-10-31 18:36:38,025 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000002_0/taskjvm.sh
2013-10-31 18:36:38,049 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_m_-1210448733
2013-10-31 18:36:38,049 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_m_-1210448733 spawned.
2013-10-31 18:36:38,052 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_m_000003_0/taskjvm.sh
2013-10-31 18:36:38,894 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_394041626 given task: attempt_20131031182606197_0020_m_000000_0
2013-10-31 18:36:39,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=null
2013-10-31 18:36:39,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43708, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7715455870848698122_1199, duration: 168586
2013-10-31 18:36:39,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:39,477 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47600, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 135760
2013-10-31 18:36:39,915 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1210448733 given task: attempt_20131031182606197_0020_m_000003_0
2013-10-31 18:36:39,925 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-873425933 given task: attempt_20131031182606197_0020_m_000001_0
2013-10-31 18:36:39,933 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-614092363 given task: attempt_20131031182606197_0020_m_000002_0
2013-10-31 18:36:40,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=null
2013-10-31 18:36:40,429 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50519, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 121380
2013-10-31 18:36:40,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=null
2013-10-31 18:36:40,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47891, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7715455870848698122_1199, duration: 141296
2013-10-31 18:36:40,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020/job.split dst=null perm=null
2013-10-31 18:36:40,454 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50521, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7715455870848698122_1199, duration: 168933
2013-10-31 18:36:40,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:40,469 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47893, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 146352
2013-10-31 18:36:40,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:40,480 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47611, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 139379
2013-10-31 18:36:40,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:36:40,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50524, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0020_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 185945
2013-10-31 18:36:42,363 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:36:42,366 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000000_0 is done.
2013-10-31 18:36:42,366 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000000_0 was 62
2013-10-31 18:36:42,367 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:42,749 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:42,749 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0020_m_000005_0
2013-10-31 18:36:42,750 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0020_m_000005_0 not found in cache
2013-10-31 18:36:43,359 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:36:43,363 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000003_0 is done.
2013-10-31 18:36:43,364 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000003_0 was 61
2013-10-31 18:36:43,364 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,370 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:36:43,372 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000002_0 is done.
2013-10-31 18:36:43,372 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000002_0 was 85
2013-10-31 18:36:43,372 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,383 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:36:43,384 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000001_0 is done.
2013-10-31 18:36:43,384 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000001_0 was 83
2013-10-31 18:36:43,385 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:43,751 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000000_0' has completed task_20131031182606197_0020_m_000000 successfully.
2013-10-31 18:36:43,754 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0020_r_000000_0' to tip task_20131031182606197_0020_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:43,757 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:36:43,757 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_r_000000_0 which needs 1 slots
2013-10-31 18:36:43,757 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000001_0' has completed task_20131031182606197_0020_m_000001 successfully.
2013-10-31 18:36:43,757 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_r_000000_0 which needs 1 slots
2013-10-31 18:36:43,780 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000002_0' has completed task_20131031182606197_0020_m_000002 successfully.
2013-10-31 18:36:43,791 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0020_r_606975538
2013-10-31 18:36:43,791 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0020_r_606975538 spawned.
2013-10-31 18:36:43,794 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0020/attempt_20131031182606197_0020_r_000000_0/taskjvm.sh
2013-10-31 18:36:43,857 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000003_0' has completed task_20131031182606197_0020_m_000003 successfully.
2013-10-31 18:36:45,335 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_r_606975538 given task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:51,022 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44606, bytes: 62, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000000_0, duration: 5878193
2013-10-31 18:36:51,039 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49565, bytes: 83, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000001_0, duration: 9433385
2013-10-31 18:36:51,056 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:39911, bytes: 85, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000002_0, duration: 12009479
2013-10-31 18:36:51,072 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:41933, bytes: 61, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0020_m_000003_0, duration: 12010657
2013-10-31 18:36:51,816 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:51,889 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:51,941 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:52,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:52,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:52,173 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000. blk_-713045408687538439_1205
2013-10-31 18:36:52,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:43729 dest: /127.0.0.1:59471
2013-10-31 18:36:52,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:47904 dest: /127.0.0.1:54365
2013-10-31 18:36:52,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-713045408687538439_1205 src: /127.0.0.1:50534 dest: /127.0.0.1:34578
2013-10-31 18:36:52,205 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50534, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-713045408687538439_1205, duration: 1547049
2013-10-31 18:36:52,205 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47904, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-713045408687538439_1205, duration: 5160934
2013-10-31 18:36:52,206 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,206 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43729, dest: /127.0.0.1:59471, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0020_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-713045408687538439_1205, duration: 5671673
2013-10-31 18:36:52,207 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-713045408687538439_1205 terminating
2013-10-31 18:36:52,208 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,208 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:52,209 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:52,209 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,209 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-713045408687538439_1205 size 128
2013-10-31 18:36:52,245 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0020_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:36:52,245 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:36:52,767 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0020_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:36:52,768 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:36:53,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0 dst=null perm=null
2013-10-31 18:36:53,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:36:53,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:53,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary/_attempt_20131031182606197_0020_r_000000_0 dst=null perm=null
2013-10-31 18:36:54,863 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:54,865 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_r_000000_0 1.0% reduce > reduce
2013-10-31 18:36:54,866 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_r_000000_0 is done.
2013-10-31 18:36:54,866 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_r_000000_0 was -1
2013-10-31 18:36:54,866 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:55,772 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_r_000000_0' has completed task_20131031182606197_0020_r_000000 successfully.
2013-10-31 18:36:55,777 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0020_m_000004_0' to tip task_20131031182606197_0020_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:36:55,779 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0020_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:36:55,779 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0020_m_000004_0 which needs 1 slots
2013-10-31 18:36:55,780 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0020_m_000004_0 which needs 1 slots
2013-10-31 18:36:55,800 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0020/attempt_20131031182606197_0020_m_000004_0. Attempting to reuse: jvm_20131031182606197_0020_m_-1374561285
2013-10-31 18:36:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:36:56,023 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,034 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,039 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,045 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,050 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:36:56,050 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:36:56,764 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0020_m_-1374561285 given task: attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,867 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000004_0 0.0%
2013-10-31 18:36:56,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary dst=null perm=null
2013-10-31 18:36:56,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:36:56,891 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS from client DFSClient_attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,892 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0020_m_000004_0
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2889835826154294416 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,898 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7715455870848698122 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7275852970796318644 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:36:56,899 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:36:56,900 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1742899109407851518 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:36:56,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0020 dst=null perm=null
2013-10-31 18:36:58,483 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200
2013-10-31 18:36:58,483 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200 blk_-1742899109407851518_1201
2013-10-31 18:36:59,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data4/current/blk_-7715455870848698122 for deletion
2013-10-31 18:36:59,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data3/current/blk_-7275852970796318644 for deletion
2013-10-31 18:36:59,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data4/current/blk_-7715455870848698122
2013-10-31 18:36:59,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data3/current/blk_-7275852970796318644
2013-10-31 18:36:59,119 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data3/current/blk_-2889835826154294416 for deletion
2013-10-31 18:36:59,120 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data3/current/blk_-2889835826154294416
2013-10-31 18:36:59,837 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0020_m_000004_0 0.0% cleanup
2013-10-31 18:36:59,838 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0020_m_000004_0 is done.
2013-10-31 18:36:59,839 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0020_m_000004_0 was -1
2013-10-31 18:36:59,839 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:36:59,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data6/current/blk_-7715455870848698122 for deletion
2013-10-31 18:36:59,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data5/current/blk_-7275852970796318644 for deletion
2013-10-31 18:36:59,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data6/current/blk_-7715455870848698122
2013-10-31 18:36:59,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data5/current/blk_-2889835826154294416 for deletion
2013-10-31 18:36:59,848 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data5/current/blk_-7275852970796318644
2013-10-31 18:36:59,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data6/current/blk_-1742899109407851518 for deletion
2013-10-31 18:36:59,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data5/current/blk_-2889835826154294416
2013-10-31 18:36:59,849 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data6/current/blk_-1742899109407851518
2013-10-31 18:37:00,317 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:37:00,319 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 2ms
2013-10-31 18:37:00,780 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:37:00,780 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0020_r_000000_0
2013-10-31 18:37:01,483 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-7275852970796318644_1200 blk_-1742899109407851518_1201
2013-10-31 18:37:01,484 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-7715455870848698122_1199 blk_-2889835826154294416_1198 blk_-1742899109407851518_1201
2013-10-31 18:37:01,787 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0020_m_000004_0' has completed task_20131031182606197_0020_m_000004 successfully.
2013-10-31 18:37:01,788 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0020 has completed successfully.
2013-10-31 18:37:01,789 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0020,submitTime=1383244589088,launchTime=1383244589820,firstMapTaskLaunchTime=1383244597740,firstReduceTaskLaunchTime=1383244603754,firstJobSetupTaskLaunchTime=1383244591717,firstJobCleanupTaskLaunchTime=1383244615776,finishTime=1383244621788,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=11,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[48399E9CDDC34DFD9CFA0870313E769E/62D39B72A191451881E805B7E8332542] test/(1/1) ...fieldedpipesplatform/swap
2013-10-31 18:37:01,795 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518. blk_-8810471189237826350_1206
2013-10-31 18:37:01,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:50538 dest: /127.0.0.1:34578
2013-10-31 18:37:01,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:43736 dest: /127.0.0.1:59471
2013-10-31 18:37:01,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8810471189237826350_1206 src: /127.0.0.1:47628 dest: /127.0.0.1:37740
2013-10-31 18:37:01,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47628, dest: /127.0.0.1:37740, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8810471189237826350_1206, duration: 2709867
2013-10-31 18:37:01,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,812 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43736, dest: /127.0.0.1:59471, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8810471189237826350_1206, duration: 3590104
2013-10-31 18:37:01,813 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,813 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50538, dest: /127.0.0.1:34578, bytes: 28302, op: HDFS_WRITE, cliID: DFSClient_-791702297, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8810471189237826350_1206, duration: 4776419
2013-10-31 18:37:01,814 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8810471189237826350_1206 terminating
2013-10-31 18:37:01,817 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,817 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 from client DFSClient_-791702297
2013-10-31 18:37:01,818 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_logs/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 is closed by DFSClient_-791702297
2013-10-31 18:37:01,818 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,818 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8810471189237826350_1206 size 28302
2013-10-31 18:37:01,824 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0020_1383244589088_hadoop_%5B48399E9CDDC34DFD9CFA0870313E769E%2F62D39B72A1914518 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:01,824 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000000_0'
2013-10-31 18:37:01,825 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000004_0'
2013-10-31 18:37:01,825 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000005_0'
2013-10-31 18:37:01,825 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_r_000000_0'
2013-10-31 18:37:01,827 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:01,827 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:01,827 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000002_0'
2013-10-31 18:37:01,827 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2967099774717268511 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:01,830 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0020_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:01,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0020 dst=null perm=null
2013-10-31 18:37:01,835 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/_temporary
2013-10-31 18:37:01,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap dst=null perm=null
2013-10-31 18:37:01,855 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1793)) - Reconciled asynchronous block scan with filesystem. 0 blocks concurrently deleted during scan, 1 blocks concurrently added during scan, 0 ongoing creations ignored
2013-10-31 18:37:01,855 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:01,855 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 0 ms
2013-10-31 18:37:01,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000 dst=null perm=null
2013-10-31 18:37:01,863 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:37740, blocks: 50, processing time: 6 msecs
2013-10-31 18:37:01,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000 dst=null perm=null
2013-10-31 18:37:01,863 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 50 blocks took 1 msec to generate and 7 msecs for RPC and NN processing
2013-10-31 18:37:01,866 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47913, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-713045408687538439_1205, duration: 292720
2013-10-31 18:37:01,866 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/swap
2013-10-31 18:37:01,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap dst=null perm=null
2013-10-31 18:37:01,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/swap/part-00000 dst=null perm=null
2013-10-31 18:37:01,875 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50543, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-713045408687538439_1205, duration: 348409
2013-10-31 18:37:01,877 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000003_0'
2013-10-31 18:37:01,897 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:01,898 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:01,912 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:37:01,912 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:37:01,913 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter"]
2013-10-31 18:37:01,913 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:37:01,913 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:37:01,913 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:37:01,914 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pipesplatform/logicfilter
2013-10-31 18:37:01,917 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:01,917 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:37:01,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:01,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:37:01,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:01,939 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar. blk_6825170116649135168_1207
2013-10-31 18:37:01,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:47915 dest: /127.0.0.1:54365
2013-10-31 18:37:01,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:47633 dest: /127.0.0.1:37740
2013-10-31 18:37:01,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:43743 dest: /127.0.0.1:59471
2013-10-31 18:37:01,951 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43743, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 3863769
2013-10-31 18:37:01,952 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,952 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47633, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6825170116649135168_1207, duration: 4729601
2013-10-31 18:37:01,952 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,953 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47915, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6825170116649135168_1207, duration: 5633437
2013-10-31 18:37:01,953 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6825170116649135168_1207 terminating
2013-10-31 18:37:01,955 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,955 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:01,956 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:01,956 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,957 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:01,961 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar. New replication is 10
2013-10-31 18:37:01,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=null
2013-10-31 18:37:01,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:01,970 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:01,974 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:01,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:02,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,245 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split. New replication is 10
2013-10-31 18:37:02,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=null
2013-10-31 18:37:02,254 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split. blk_-6356891254658155288_1208
2013-10-31 18:37:02,256 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:43744 dest: /127.0.0.1:59471
2013-10-31 18:37:02,257 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:47919 dest: /127.0.0.1:54365
2013-10-31 18:37:02,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:50549 dest: /127.0.0.1:34578
2013-10-31 18:37:02,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6356891254658155288_1208 src: /127.0.0.1:47638 dest: /127.0.0.1:37740
2013-10-31 18:37:02,264 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47638, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6356891254658155288_1208, duration: 120323
2013-10-31 18:37:02,264 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50549, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 942963
2013-10-31 18:37:02,265 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47919, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6356891254658155288_1208, duration: 1849947
2013-10-31 18:37:02,266 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,266 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,266 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43744, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6356891254658155288_1208, duration: 2660244
2013-10-31 18:37:02,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,267 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-6356891254658155288_1208 terminating
2013-10-31 18:37:02,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,270 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split from client DFSClient_-1596270109
2013-10-31 18:37:02,270 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:02,271 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6356891254658155288_1208 size 1403
2013-10-31 18:37:02,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,288 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo. blk_-4498923493520451421_1209
2013-10-31 18:37:02,289 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:47639 dest: /127.0.0.1:37740
2013-10-31 18:37:02,291 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:47923 dest: /127.0.0.1:54365
2013-10-31 18:37:02,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4498923493520451421_1209 src: /127.0.0.1:50553 dest: /127.0.0.1:34578
2013-10-31 18:37:02,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50553, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4498923493520451421_1209, duration: 70407
2013-10-31 18:37:02,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47923, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4498923493520451421_1209, duration: 887546
2013-10-31 18:37:02,297 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,297 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47639, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4498923493520451421_1209, duration: 1677436
2013-10-31 18:37:02,298 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4498923493520451421_1209 terminating
2013-10-31 18:37:02,301 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,302 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:02,302 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:02,302 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,303 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4498923493520451421_1209 size 156
2013-10-31 18:37:02,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,323 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml. blk_5776063125288327320_1210
2013-10-31 18:37:02,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:47925 dest: /127.0.0.1:54365
2013-10-31 18:37:02,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:43752 dest: /127.0.0.1:59471
2013-10-31 18:37:02,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5776063125288327320_1210 src: /127.0.0.1:50556 dest: /127.0.0.1:34578
2013-10-31 18:37:02,328 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50556, dest: /127.0.0.1:34578, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5776063125288327320_1210, duration: 791145
2013-10-31 18:37:02,328 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,328 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43752, dest: /127.0.0.1:59471, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5776063125288327320_1210, duration: 644962
2013-10-31 18:37:02,328 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,329 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47925, dest: /127.0.0.1:54365, bytes: 27480, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 1477387
2013-10-31 18:37:02,328 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,329 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5776063125288327320_1210 terminating
2013-10-31 18:37:02,330 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,331 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:02,331 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:02,332 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5776063125288327320_1210 size 27480
2013-10-31 18:37:02,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=null
2013-10-31 18:37:02,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50558, bytes: 27696, op: HDFS_READ, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5776063125288327320_1210, duration: 189164
2013-10-31 18:37:02,356 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0021: nMaps=4 nReduces=0 max=-1
2013-10-31 18:37:02,356 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0021 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:02,356 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0021 RESULT=SUCCESS
2013-10-31 18:37:02,357 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0021
2013-10-31 18:37:02,357 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0021
2013-10-31 18:37:02,357 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0021
2013-10-31 18:37:02,359 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 78 raw values into 1 aggregated values, total 6
2013-10-31 18:37:02,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,375 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml. blk_-7503252741964220374_1212
2013-10-31 18:37:02,378 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:50559 dest: /127.0.0.1:34578
2013-10-31 18:37:02,378 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:47648 dest: /127.0.0.1:37740
2013-10-31 18:37:02,379 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7503252741964220374_1212 src: /127.0.0.1:47932 dest: /127.0.0.1:54365
2013-10-31 18:37:02,381 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47932, dest: /127.0.0.1:54365, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7503252741964220374_1212, duration: 101245
2013-10-31 18:37:02,381 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,381 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47648, dest: /127.0.0.1:37740, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7503252741964220374_1212, duration: 474462
2013-10-31 18:37:02,381 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,382 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50559, dest: /127.0.0.1:34578, bytes: 27545, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7503252741964220374_1212, duration: 1009870
2013-10-31 18:37:02,382 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7503252741964220374_1212 terminating
2013-10-31 18:37:02,384 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,384 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml from client DFSClient_1340806675
2013-10-31 18:37:02,385 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_conf.xml is closed by DFSClient_1340806675
2013-10-31 18:37:02,385 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,386 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7503252741964220374_1212 size 27545
2013-10-31 18:37:02,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:02,396 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken. blk_-3539146678558007319_1213
2013-10-31 18:37:02,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:47650 dest: /127.0.0.1:37740
2013-10-31 18:37:02,398 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:43760 dest: /127.0.0.1:59471
2013-10-31 18:37:02,400 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3539146678558007319_1213 src: /127.0.0.1:47935 dest: /127.0.0.1:54365
2013-10-31 18:37:02,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47935, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3539146678558007319_1213, duration: 804346
2013-10-31 18:37:02,401 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,402 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43760, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 450050
2013-10-31 18:37:02,402 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,403 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47650, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3539146678558007319_1213, duration: 1572516
2013-10-31 18:37:02,403 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3539146678558007319_1213 terminating
2013-10-31 18:37:02,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,405 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:02,405 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:02,405 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,406 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3539146678558007319_1213 size 116
2013-10-31 18:37:02,410 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken
2013-10-31 18:37:02,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.splitmetainfo dst=null perm=null
2013-10-31 18:37:02,414 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47653, bytes: 160, op: HDFS_READ, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4498923493520451421_1209, duration: 124532
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0021 = 1449. Number of splits = 4
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,415 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0021_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0021 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:02,416 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0021 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:37:03,246 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data2/current/blk_-7715455870848698122 for deletion
2013-10-31 18:37:03,246 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7275852970796318644_1200 file build/test/data/dfs/data/data1/current/blk_-7275852970796318644 for deletion
2013-10-31 18:37:03,246 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data2/current/blk_-7715455870848698122
2013-10-31 18:37:03,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7275852970796318644_1200 at file build/test/data/dfs/data/data1/current/blk_-7275852970796318644
2013-10-31 18:37:03,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data1/current/blk_-2889835826154294416 for deletion
2013-10-31 18:37:03,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data2/current/blk_-1742899109407851518 for deletion
2013-10-31 18:37:03,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data1/current/blk_-2889835826154294416
2013-10-31 18:37:03,248 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data2/current/blk_-1742899109407851518
2013-10-31 18:37:03,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7715455870848698122_1199 file build/test/data/dfs/data/data7/current/blk_-7715455870848698122 for deletion
2013-10-31 18:37:03,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2889835826154294416_1198 file build/test/data/dfs/data/data7/current/blk_-2889835826154294416 for deletion
2013-10-31 18:37:03,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7715455870848698122_1199 at file build/test/data/dfs/data/data7/current/blk_-7715455870848698122
2013-10-31 18:37:03,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1742899109407851518_1201 file build/test/data/dfs/data/data8/current/blk_-1742899109407851518 for deletion
2013-10-31 18:37:03,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2889835826154294416_1198 at file build/test/data/dfs/data/data7/current/blk_-2889835826154294416
2013-10-31 18:37:03,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1742899109407851518_1201 at file build/test/data/dfs/data/data8/current/blk_-1742899109407851518
2013-10-31 18:37:04,485 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_6825170116649135168_1207 to datanode(s) 127.0.0.1:34578
2013-10-31 18:37:04,485 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_2967099774717268511_1204
2013-10-31 18:37:04,485 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_2967099774717268511_1204
2013-10-31 18:37:04,791 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0021_m_000005_0' to tip task_20131031182606197_0021_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:04,797 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0020_m_000001_0'
2013-10-31 18:37:04,799 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:04,799 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000005_0 which needs 1 slots
2013-10-31 18:37:04,799 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000005_0 which needs 1 slots
2013-10-31 18:37:04,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken dst=null perm=null
2013-10-31 18:37:04,808 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43763, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 303610
2013-10-31 18:37:04,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=null
2013-10-31 18:37:04,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47939, bytes: 27696, op: HDFS_READ, cliID: DFSClient_1546836711, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 397974
2013-10-31 18:37:04,850 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:04,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=null
2013-10-31 18:37:04,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43766, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1546836711, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 890813
2013-10-31 18:37:04,931 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:04,932 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-536120217 spawned.
2013-10-31 18:37:04,933 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000005_0/taskjvm.sh
2013-10-31 18:37:06,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data2/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:06,247 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data2/current/blk_2967099774717268511
2013-10-31 18:37:06,278 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-536120217 given task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:06,319 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_6825170116649135168_1207 to 127.0.0.1:34578
2013-10-31 18:37:06,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data8/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:06,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data8/current/blk_2967099774717268511
2013-10-31 18:37:06,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6825170116649135168_1207 src: /127.0.0.1:50571 dest: /127.0.0.1:34578
2013-10-31 18:37:06,321 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_6825170116649135168_1207 to /127.0.0.1:34578
2013-10-31 18:37:06,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6825170116649135168_1207 src: /127.0.0.1:50571 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:37:06,323 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6825170116649135168_1207 size 238055
2013-10-31 18:37:06,827 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,828 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0020_m_000004_0 not found in cache
2013-10-31 18:37:06,828 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026828
2013-10-31 18:37:06,867 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,868 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026868
2013-10-31 18:37:06,878 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:06,879 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331026879
2013-10-31 18:37:06,944 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_394041626 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:06,955 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27856 with signal TERM. Exit code 0
2013-10-31 18:37:07,165 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:07,165 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:07,165 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:07,166 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_394041626 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:07,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:07,441 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_r_606975538 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:07,451 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28103 with signal TERM. Exit code 0
2013-10-31 18:37:07,486 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_2967099774717268511_1204
2013-10-31 18:37:07,632 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:07,632 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:07,632 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:07,632 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_r_606975538 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:07,877 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-1374561285 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:07,887 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27652 with signal TERM. Exit code 0
2013-10-31 18:37:08,099 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,100 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,100 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:08,100 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-1374561285 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:37:08,160 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-614092363 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:08,165 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-1210448733 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:08,171 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27906 with signal TERM. Exit code 0
2013-10-31 18:37:08,184 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27905 with signal TERM. Exit code 0
2013-10-31 18:37:08,387 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,387 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,387 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:08,387 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-1210448733 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:08,399 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:08,399 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:08,399 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:08,399 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-614092363 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:08,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2967099774717268511_1204 file build/test/data/dfs/data/data5/current/blk_2967099774717268511 for deletion
2013-10-31 18:37:08,851 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2967099774717268511_1204 at file build/test/data/dfs/data/data5/current/blk_2967099774717268511
2013-10-31 18:37:09,718 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000005_0 0.0% setup
2013-10-31 18:37:09,721 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000005_0 is done.
2013-10-31 18:37:09,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000005_0 was -1
2013-10-31 18:37:09,722 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:09,799 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0020
2013-10-31 18:37:09,800 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0020 for user-log deletion with retainTimeStamp:1383331029800
2013-10-31 18:37:10,805 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000005_0' has completed task_20131031182606197_0021_m_000005 successfully.
2013-10-31 18:37:10,809 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000000_0' to tip task_20131031182606197_0021_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:10,810 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000000
2013-10-31 18:37:10,812 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:10,812 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000000_0 which needs 1 slots
2013-10-31 18:37:10,812 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000000_0 which needs 1 slots
2013-10-31 18:37:10,838 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000001_0' to tip task_20131031182606197_0021_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:10,839 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000001
2013-10-31 18:37:10,840 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:10,841 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000001_0 which needs 1 slots
2013-10-31 18:37:10,841 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000001_0 which needs 1 slots
2013-10-31 18:37:10,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken dst=null perm=null
2013-10-31 18:37:10,848 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0021/attempt_20131031182606197_0021_m_000000_0. Attempting to reuse: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:10,849 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43770, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 281323
2013-10-31 18:37:10,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=null
2013-10-31 18:37:10,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43772, bytes: 27696, op: HDFS_READ, cliID: DFSClient_-610174536, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5776063125288327320_1210, duration: 184847
2013-10-31 18:37:10,876 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000002_0' to tip task_20131031182606197_0021_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:10,877 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000002
2013-10-31 18:37:10,879 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:10,879 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000002_0 which needs 1 slots
2013-10-31 18:37:10,880 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000002_0 which needs 1 slots
2013-10-31 18:37:10,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken dst=null perm=null
2013-10-31 18:37:10,886 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0021_m_000003_0' to tip task_20131031182606197_0021_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:10,887 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0021_m_000003
2013-10-31 18:37:10,887 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,888 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:10,889 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000003_0 which needs 1 slots
2013-10-31 18:37:10,889 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43773, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3539146678558007319_1213, duration: 263093
2013-10-31 18:37:10,889 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000003_0 which needs 1 slots
2013-10-31 18:37:10,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021/jobToken dst=null perm=null
2013-10-31 18:37:10,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=null
2013-10-31 18:37:10,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47666, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3539146678558007319_1213, duration: 263293
2013-10-31 18:37:10,900 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47950, bytes: 27696, op: HDFS_READ, cliID: DFSClient_409215913, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 395761
2013-10-31 18:37:10,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.xml dst=null perm=null
2013-10-31 18:37:10,908 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47952, bytes: 27696, op: HDFS_READ, cliID: DFSClient_-751574938, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5776063125288327320_1210, duration: 389891
2013-10-31 18:37:10,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=null
2013-10-31 18:37:10,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43779, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-610174536, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6825170116649135168_1207, duration: 1568564
2013-10-31 18:37:10,920 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,921 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:10,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=null
2013-10-31 18:37:10,937 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47954, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-751574938, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6825170116649135168_1207, duration: 644130
2013-10-31 18:37:10,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.jar dst=null perm=null
2013-10-31 18:37:10,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47672, bytes: 239915, op: HDFS_READ, cliID: DFSClient_409215913, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6825170116649135168_1207, duration: 618863
2013-10-31 18:37:10,992 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1495739159
2013-10-31 18:37:10,992 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1495739159 spawned.
2013-10-31 18:37:10,995 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000001_0/taskjvm.sh
2013-10-31 18:37:10,999 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1540473190
2013-10-31 18:37:11,000 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1540473190 spawned.
2013-10-31 18:37:11,001 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000003_0/taskjvm.sh
2013-10-31 18:37:11,004 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_-1217830969
2013-10-31 18:37:11,004 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_-1217830969 spawned.
2013-10-31 18:37:11,005 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000002_0/taskjvm.sh
2013-10-31 18:37:11,163 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0020_m_-873425933 since job job_20131031182606197_0020 is dead
2013-10-31 18:37:11,173 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group27907 with signal TERM. Exit code 0
2013-10-31 18:37:11,270 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-536120217 given task: attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:11,404 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:11,404 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:11,404 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:11,404 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0020_m_-873425933 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:11,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=null
2013-10-31 18:37:11,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43783, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6356891254658155288_1208, duration: 174221
2013-10-31 18:37:11,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:11,859 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50587, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 131597
2013-10-31 18:37:11,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:11,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:12,072 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000. blk_-2773960523731250447_1214
2013-10-31 18:37:12,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:50588 dest: /127.0.0.1:34578
2013-10-31 18:37:12,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:47960 dest: /127.0.0.1:54365
2013-10-31 18:37:12,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2773960523731250447_1214 src: /127.0.0.1:47678 dest: /127.0.0.1:37740
2013-10-31 18:37:12,100 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47678, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2773960523731250447_1214, duration: 1622769
2013-10-31 18:37:12,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47960, dest: /127.0.0.1:54365, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 2042619
2013-10-31 18:37:12,101 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,101 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50588, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2773960523731250447_1214, duration: 2486929
2013-10-31 18:37:12,102 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2773960523731250447_1214 terminating
2013-10-31 18:37:12,102 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,102 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,103 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2773960523731250447_1214 size 181
2013-10-31 18:37:12,103 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:12,103 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:12,140 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:12,141 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000000_0 0.0%
2013-10-31 18:37:12,548 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1540473190 given task: attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:12,554 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1217830969 given task: attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:12,558 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_-1495739159 given task: attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=null
2013-10-31 18:37:13,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50597, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 129407
2013-10-31 18:37:13,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=null
2013-10-31 18:37:13,053 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50598, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6356891254658155288_1208, duration: 143377
2013-10-31 18:37:13,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021/job.split dst=null perm=null
2013-10-31 18:37:13,063 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47687, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6356891254658155288_1208, duration: 142953
2013-10-31 18:37:13,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:13,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50600, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 143084
2013-10-31 18:37:13,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:13,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:13,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,102 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47972, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 163408
2013-10-31 18:37:13,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:13,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:13,268 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003. blk_-4087558079339850927_1217
2013-10-31 18:37:13,270 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50602, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 192067
2013-10-31 18:37:13,274 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001. blk_2038428419949332083_1217
2013-10-31 18:37:13,286 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,286 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:47691 dest: /127.0.0.1:37740
2013-10-31 18:37:13,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:43802 dest: /127.0.0.1:59471
2013-10-31 18:37:13,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4087558079339850927_1217 src: /127.0.0.1:47977 dest: /127.0.0.1:54365
2013-10-31 18:37:13,303 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47977, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4087558079339850927_1217, duration: 1380604
2013-10-31 18:37:13,303 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,304 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43802, dest: /127.0.0.1:59471, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4087558079339850927_1217, duration: 1711572
2013-10-31 18:37:13,304 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,304 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47691, dest: /127.0.0.1:37740, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4087558079339850927_1217, duration: 2074382
2013-10-31 18:37:13,304 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4087558079339850927_1217 terminating
2013-10-31 18:37:13,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:47692 dest: /127.0.0.1:37740
2013-10-31 18:37:13,306 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:43804 dest: /127.0.0.1:59471
2013-10-31 18:37:13,308 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,308 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2038428419949332083_1217 src: /127.0.0.1:50608 dest: /127.0.0.1:34578
2013-10-31 18:37:13,308 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4087558079339850927_1217 size 180
2013-10-31 18:37:13,310 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50608, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2038428419949332083_1217, duration: 1681276
2013-10-31 18:37:13,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43804, dest: /127.0.0.1:59471, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 2103702
2013-10-31 18:37:13,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,311 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47692, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0021_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2038428419949332083_1217, duration: 2460134
2013-10-31 18:37:13,311 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2038428419949332083_1217 terminating
2013-10-31 18:37:13,312 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,312 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,312 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,312 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,314 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2038428419949332083_1217 size 134
2013-10-31 18:37:13,332 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,333 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000002_0 0.0%
2013-10-31 18:37:13,361 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,361 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000001_0 0.0%
2013-10-31 18:37:13,706 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:13,707 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:13,771 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0021_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:13,771 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000003_0 0.0%
2013-10-31 18:37:13,816 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000000_0
2013-10-31 18:37:13,844 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000001_0
2013-10-31 18:37:13,883 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000002_0
2013-10-31 18:37:13,892 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0021_m_000003_0
2013-10-31 18:37:14,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0 dst=null perm=null
2013-10-31 18:37:14,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:14,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000000_0 dst=null perm=null
2013-10-31 18:37:14,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0 dst=null perm=null
2013-10-31 18:37:14,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0 dst=null perm=null
2013-10-31 18:37:14,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:14,775 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:37:14,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000000_0 is done.
2013-10-31 18:37:14,777 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000000_0 was -1
2013-10-31 18:37:14,778 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0 dst=null perm=null
2013-10-31 18:37:15,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:15,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:15,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000002_0 dst=null perm=null
2013-10-31 18:37:15,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000001_0 dst=null perm=null
2013-10-31 18:37:15,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary/_attempt_20131031182606197_0021_m_000003_0 dst=null perm=null
2013-10-31 18:37:15,812 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:15,813 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0021_m_000005_0
2013-10-31 18:37:15,813 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000005_0 not found in cache
2013-10-31 18:37:15,974 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:37:15,976 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000003_0 is done.
2013-10-31 18:37:15,976 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000003_0 was -1
2013-10-31 18:37:15,976 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,983 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:37:15,984 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000001_0 is done.
2013-10-31 18:37:15,985 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000001_0 was -1
2013-10-31 18:37:15,985 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:15,992 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:37:15,993 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000002_0 is done.
2013-10-31 18:37:15,993 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000002_0 was -1
2013-10-31 18:37:15,994 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:16,820 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000000_0' has completed task_20131031182606197_0021_m_000000 successfully.
2013-10-31 18:37:16,848 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000001_0' has completed task_20131031182606197_0021_m_000001 successfully.
2013-10-31 18:37:16,886 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000002_0' has completed task_20131031182606197_0021_m_000002 successfully.
2013-10-31 18:37:16,895 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000003_0' has completed task_20131031182606197_0021_m_000003 successfully.
2013-10-31 18:37:16,899 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0021_m_000004_0' to tip task_20131031182606197_0021_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:16,901 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0021_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:37:16,901 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0021_m_000004_0 which needs 1 slots
2013-10-31 18:37:16,901 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0021_m_000004_0 which needs 1 slots
2013-10-31 18:37:16,933 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0021_m_949917260
2013-10-31 18:37:16,934 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0021_m_949917260 spawned.
2013-10-31 18:37:16,936 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0021/attempt_20131031182606197_0021_m_000004_0/taskjvm.sh
2013-10-31 18:37:17,769 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0021_m_949917260 given task: attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,262 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000004_0 0.0%
2013-10-31 18:37:18,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary dst=null perm=null
2013-10-31 18:37:18,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:18,283 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS from client DFSClient_attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,283 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0021_m_000004_0
2013-10-31 18:37:18,289 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,289 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,289 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,289 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6825170116649135168 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6356891254658155288 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,290 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,291 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4498923493520451421 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:18,291 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:18,291 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:18,291 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5776063125288327320 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:18,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0021 dst=null perm=null
2013-10-31 18:37:19,488 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_5776063125288327320_1210 blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:19,488 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5776063125288327320_1210 blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:20,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data3/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:20,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data4/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:20,126 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data3/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:20,127 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data4/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:20,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data3/current/blk_-6356891254658155288
2013-10-31 18:37:20,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data3/current/blk_5776063125288327320
2013-10-31 18:37:20,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data4/current/blk_-4498923493520451421
2013-10-31 18:37:20,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data4/current/blk_6825170116649135168
2013-10-31 18:37:21,197 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0021_m_000004_0 0.0% cleanup
2013-10-31 18:37:21,199 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0021_m_000004_0 is done.
2013-10-31 18:37:21,199 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0021_m_000004_0 was -1
2013-10-31 18:37:21,200 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:21,251 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data1/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:21,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data2/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:21,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data1/current/blk_-6356891254658155288
2013-10-31 18:37:21,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data2/current/blk_-4498923493520451421
2013-10-31 18:37:21,252 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data1/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:21,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data1/current/blk_5776063125288327320
2013-10-31 18:37:21,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data1/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:21,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data1/current/blk_6825170116649135168
2013-10-31 18:37:22,489 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4498923493520451421_1209 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:22,489 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5776063125288327320_1210 blk_6825170116649135168_1207 blk_-6356891254658155288_1208
2013-10-31 18:37:22,909 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0021_m_000004_0' has completed task_20131031182606197_0021_m_000004 successfully.
2013-10-31 18:37:22,910 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0021 has completed successfully.
2013-10-31 18:37:22,911 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0021,submitTime=1383244622335,launchTime=1383244622416,firstMapTaskLaunchTime=1383244630808,firstJobSetupTaskLaunchTime=1383244624790,firstJobCleanupTaskLaunchTime=1383244636899,finishTime=1383244642910,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[D9B1645405A54AE19107C776496603BD/7AE21C4F457146A7A8D58E2E27F779D9] test/(1/1) ...pipesplatform/logicfilter
2013-10-31 18:37:22,916 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7. blk_-4297281594000158562_1218
2013-10-31 18:37:22,918 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:50613 dest: /127.0.0.1:34578
2013-10-31 18:37:22,921 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:43811 dest: /127.0.0.1:59471
2013-10-31 18:37:22,922 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4297281594000158562_1218 src: /127.0.0.1:47703 dest: /127.0.0.1:37740
2013-10-31 18:37:22,925 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47703, dest: /127.0.0.1:37740, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4297281594000158562_1218, duration: 193181
2013-10-31 18:37:22,926 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,926 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43811, dest: /127.0.0.1:59471, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4297281594000158562_1218, duration: 1008175
2013-10-31 18:37:22,927 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,927 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50613, dest: /127.0.0.1:34578, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_1340806675, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4297281594000158562_1218, duration: 2235112
2013-10-31 18:37:22,928 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4297281594000158562_1218 terminating
2013-10-31 18:37:22,931 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,933 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,933 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4297281594000158562_1218 size 22363
2013-10-31 18:37:22,934 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 from client DFSClient_1340806675
2013-10-31 18:37:22,935 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_logs/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 is closed by DFSClient_1340806675
2013-10-31 18:37:22,942 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0021_1383244622335_hadoop_%5BD9B1645405A54AE19107C776496603BD%2F7AE21C4F457146A7 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:22,943 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000003_0'
2013-10-31 18:37:22,943 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000004_0'
2013-10-31 18:37:22,945 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:22,945 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:22,945 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3539146678558007319 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:22,948 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0021_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:22,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0021 dst=null perm=null
2013-10-31 18:37:22,952 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/_temporary
2013-10-31 18:37:22,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=null
2013-10-31 18:37:22,974 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:37:22,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000 dst=null perm=null
2013-10-31 18:37:22,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001 dst=null perm=null
2013-10-31 18:37:22,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002 dst=null perm=null
2013-10-31 18:37:22,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003 dst=null perm=null
2013-10-31 18:37:22,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000 dst=null perm=null
2013-10-31 18:37:22,983 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47988, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 350219
2013-10-31 18:37:22,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001 dst=null perm=null
2013-10-31 18:37:22,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43815, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 262448
2013-10-31 18:37:22,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002 dst=null perm=null
2013-10-31 18:37:22,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003 dst=null perm=null
2013-10-31 18:37:22,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47990, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4087558079339850927_1217, duration: 366764
2013-10-31 18:37:22,991 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/logicfilter
2013-10-31 18:37:22,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter dst=null perm=null
2013-10-31 18:37:22,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00000 dst=null perm=null
2013-10-31 18:37:22,999 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:47991, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2773960523731250447_1214, duration: 260214
2013-10-31 18:37:23,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00001 dst=null perm=null
2013-10-31 18:37:23,003 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43818, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2038428419949332083_1217, duration: 269115
2013-10-31 18:37:23,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00002 dst=null perm=null
2013-10-31 18:37:23,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/logicfilter/part-00003 dst=null perm=null
2013-10-31 18:37:23,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47710, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4087558079339850927_1217, duration: 283084
2013-10-31 18:37:23,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,021 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt. blk_-677913094566701302_1219
2013-10-31 18:37:23,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:47711 dest: /127.0.0.1:37740
2013-10-31 18:37:23,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:47995 dest: /127.0.0.1:54365
2013-10-31 18:37:23,026 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-677913094566701302_1219 src: /127.0.0.1:50625 dest: /127.0.0.1:34578
2013-10-31 18:37:23,029 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50625, dest: /127.0.0.1:34578, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 90478
2013-10-31 18:37:23,030 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,030 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47995, dest: /127.0.0.1:54365, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 948676
2013-10-31 18:37:23,031 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,031 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,031 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47711, dest: /127.0.0.1:37740, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 1889544
2013-10-31 18:37:23,032 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-677913094566701302_1219 terminating
2013-10-31 18:37:23,035 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,035 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt from client DFSClient_-1596270109
2013-10-31 18:37:23,035 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:37:23,036 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-677913094566701302_1219 size 30
2013-10-31 18:37:23,061 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:23,062 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:23,073 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:37:23,073 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt"]
2013-10-31 18:37:23,074 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped"]
2013-10-31 18:37:23,074 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:37:23,074 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:37:23,074 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:37:23,075 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...edpipesplatform/ungrouped
2013-10-31 18:37:23,078 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:23,078 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:37:23,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:23,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:37:23,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,099 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar. blk_6835416087934708249_1220
2013-10-31 18:37:23,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:43823 dest: /127.0.0.1:59471
2013-10-31 18:37:23,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:47715 dest: /127.0.0.1:37740
2013-10-31 18:37:23,103 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:50628 dest: /127.0.0.1:34578
2013-10-31 18:37:23,115 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50628, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6835416087934708249_1220, duration: 7009306
2013-10-31 18:37:23,115 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,116 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47715, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6835416087934708249_1220, duration: 7729560
2013-10-31 18:37:23,116 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,117 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43823, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 8742752
2013-10-31 18:37:23,117 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6835416087934708249_1220 terminating
2013-10-31 18:37:23,119 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:23,119 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:23,119 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,120 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:23,124 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar. New replication is 10
2013-10-31 18:37:23,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=null
2013-10-31 18:37:23,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,138 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:23,142 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:23,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:23,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,733 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split. New replication is 10
2013-10-31 18:37:23,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:23,739 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split. blk_-7549849351233677898_1221
2013-10-31 18:37:23,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:50629 dest: /127.0.0.1:34578
2013-10-31 18:37:23,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:43827 dest: /127.0.0.1:59471
2013-10-31 18:37:23,744 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:48002 dest: /127.0.0.1:54365
2013-10-31 18:37:23,746 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7549849351233677898_1221 src: /127.0.0.1:47720 dest: /127.0.0.1:37740
2013-10-31 18:37:23,749 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47720, dest: /127.0.0.1:37740, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 114008
2013-10-31 18:37:23,750 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,750 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48002, dest: /127.0.0.1:54365, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7549849351233677898_1221, duration: 934525
2013-10-31 18:37:23,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,751 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43827, dest: /127.0.0.1:59471, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7549849351233677898_1221, duration: 1999441
2013-10-31 18:37:23,752 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,752 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,752 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50629, dest: /127.0.0.1:34578, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 2815886
2013-10-31 18:37:23,753 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7549849351233677898_1221 terminating
2013-10-31 18:37:23,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,756 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split from client DFSClient_-1596270109
2013-10-31 18:37:23,756 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:23,757 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7549849351233677898_1221 size 1762
2013-10-31 18:37:23,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,774 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo. blk_-7735072202814239768_1222
2013-10-31 18:37:23,775 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:50633 dest: /127.0.0.1:34578
2013-10-31 18:37:23,777 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:48005 dest: /127.0.0.1:54365
2013-10-31 18:37:23,779 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7735072202814239768_1222 src: /127.0.0.1:47723 dest: /127.0.0.1:37740
2013-10-31 18:37:23,782 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47723, dest: /127.0.0.1:37740, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7735072202814239768_1222, duration: 628409
2013-10-31 18:37:23,782 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,782 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,782 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48005, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7735072202814239768_1222, duration: 800390
2013-10-31 18:37:23,783 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,783 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50633, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7735072202814239768_1222, duration: 1798117
2013-10-31 18:37:23,784 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,784 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7735072202814239768_1222 terminating
2013-10-31 18:37:23,788 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:23,788 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:23,788 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7735072202814239768_1222 size 183
2013-10-31 18:37:23,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,812 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml. blk_20087189836750365_1223
2013-10-31 18:37:23,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:50636 dest: /127.0.0.1:34578
2013-10-31 18:37:23,816 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:43834 dest: /127.0.0.1:59471
2013-10-31 18:37:23,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_20087189836750365_1223 src: /127.0.0.1:48009 dest: /127.0.0.1:54365
2013-10-31 18:37:23,820 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48009, dest: /127.0.0.1:54365, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_20087189836750365_1223, duration: 355482
2013-10-31 18:37:23,820 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,821 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43834, dest: /127.0.0.1:59471, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 1114039
2013-10-31 18:37:23,821 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,822 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50636, dest: /127.0.0.1:34578, bytes: 27496, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_20087189836750365_1223, duration: 2025640
2013-10-31 18:37:23,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_20087189836750365_1223 terminating
2013-10-31 18:37:23,824 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,824 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:23,825 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:23,825 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,825 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_20087189836750365_1223 size 27496
2013-10-31 18:37:23,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=null
2013-10-31 18:37:23,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43837, bytes: 27712, op: HDFS_READ, cliID: DFSClient_874298567, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 412687
2013-10-31 18:37:23,841 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0022: nMaps=5 nReduces=0 max=-1
2013-10-31 18:37:23,841 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0022 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:23,841 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0022 RESULT=SUCCESS
2013-10-31 18:37:23,841 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0022
2013-10-31 18:37:23,842 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0022
2013-10-31 18:37:23,842 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0022
2013-10-31 18:37:23,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,855 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data5/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:23,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5776063125288327320_1210 file build/test/data/dfs/data/data6/current/blk_5776063125288327320 for deletion
2013-10-31 18:37:23,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data5/current/blk_-6356891254658155288
2013-10-31 18:37:23,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5776063125288327320_1210 at file build/test/data/dfs/data/data6/current/blk_5776063125288327320
2013-10-31 18:37:23,856 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data6/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:23,857 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data6/current/blk_6825170116649135168
2013-10-31 18:37:23,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,869 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml. blk_-6454450828301364300_1225
2013-10-31 18:37:23,871 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:50641 dest: /127.0.0.1:34578
2013-10-31 18:37:23,872 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:48013 dest: /127.0.0.1:54365
2013-10-31 18:37:23,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6454450828301364300_1225 src: /127.0.0.1:47731 dest: /127.0.0.1:37740
2013-10-31 18:37:23,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47731, dest: /127.0.0.1:37740, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6454450828301364300_1225, duration: 614976
2013-10-31 18:37:23,879 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,879 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48013, dest: /127.0.0.1:54365, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6454450828301364300_1225, duration: 2210804
2013-10-31 18:37:23,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,880 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,880 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50641, dest: /127.0.0.1:34578, bytes: 27561, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6454450828301364300_1225, duration: 2519936
2013-10-31 18:37:23,881 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6454450828301364300_1225 terminating
2013-10-31 18:37:23,884 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml from client DFSClient_874298567
2013-10-31 18:37:23,884 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_conf.xml is closed by DFSClient_874298567
2013-10-31 18:37:23,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,885 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6454450828301364300_1225 size 27561
2013-10-31 18:37:23,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:23,897 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken. blk_8993012588869726418_1226
2013-10-31 18:37:23,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:47732 dest: /127.0.0.1:37740
2013-10-31 18:37:23,901 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:50645 dest: /127.0.0.1:34578
2013-10-31 18:37:23,902 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8993012588869726418_1226 src: /127.0.0.1:48017 dest: /127.0.0.1:54365
2013-10-31 18:37:23,905 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48017, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8993012588869726418_1226, duration: 92121
2013-10-31 18:37:23,905 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,906 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50645, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 930164
2013-10-31 18:37:23,906 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,907 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47732, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8993012588869726418_1226, duration: 1736980
2013-10-31 18:37:23,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,907 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8993012588869726418_1226 terminating
2013-10-31 18:37:23,909 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8993012588869726418_1226 size 116
2013-10-31 18:37:23,910 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:23,911 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:23,916 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken
2013-10-31 18:37:23,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.splitmetainfo dst=null perm=null
2013-10-31 18:37:23,920 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48018, bytes: 187, op: HDFS_READ, cliID: DFSClient_874298567, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7735072202814239768_1222, duration: 279329
2013-10-31 18:37:23,921 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0022 = 30. Number of splits = 5
2013-10-31 18:37:23,921 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,922 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,923 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,924 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0022_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:23,925 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0022 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:23,926 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0022 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 18:37:24,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6356891254658155288_1208 file build/test/data/dfs/data/data8/current/blk_-6356891254658155288 for deletion
2013-10-31 18:37:24,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4498923493520451421_1209 file build/test/data/dfs/data/data7/current/blk_-4498923493520451421 for deletion
2013-10-31 18:37:24,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6356891254658155288_1208 at file build/test/data/dfs/data/data8/current/blk_-6356891254658155288
2013-10-31 18:37:24,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4498923493520451421_1209 at file build/test/data/dfs/data/data7/current/blk_-4498923493520451421
2013-10-31 18:37:24,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6825170116649135168_1207 file build/test/data/dfs/data/data7/current/blk_6825170116649135168 for deletion
2013-10-31 18:37:24,327 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6825170116649135168_1207 at file build/test/data/dfs/data/data7/current/blk_6825170116649135168
2013-10-31 18:37:25,490 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6835416087934708249_1220 to datanode(s) 127.0.0.1:54365
2013-10-31 18:37:25,490 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-3539146678558007319_1213
2013-10-31 18:37:25,491 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3539146678558007319_1213
2013-10-31 18:37:25,835 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0022_m_000006_0' to tip task_20131031182606197_0022_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:25,840 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000000_0'
2013-10-31 18:37:25,841 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000005_0'
2013-10-31 18:37:25,842 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:37:25,842 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000006_0 which needs 1 slots
2013-10-31 18:37:25,843 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000006_0 which needs 1 slots
2013-10-31 18:37:25,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken dst=null perm=null
2013-10-31 18:37:25,851 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47737, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8993012588869726418_1226, duration: 351575
2013-10-31 18:37:25,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=null
2013-10-31 18:37:25,861 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000001_0'
2013-10-31 18:37:25,863 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43848, bytes: 27712, op: HDFS_READ, cliID: DFSClient_1200487348, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 437112
2013-10-31 18:37:25,903 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0021_m_000002_0'
2013-10-31 18:37:25,908 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:25,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=null
2013-10-31 18:37:25,936 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43849, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1200487348, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 1181251
2013-10-31 18:37:26,043 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:26,044 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_412155634 spawned.
2013-10-31 18:37:26,046 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000006_0/taskjvm.sh
2013-10-31 18:37:26,128 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data3/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:26,128 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data3/current/blk_-3539146678558007319
2013-10-31 18:37:26,857 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data5/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:26,857 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data5/current/blk_-3539146678558007319
2013-10-31 18:37:27,253 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6835416087934708249_1220 to 127.0.0.1:54365
2013-10-31 18:37:27,256 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6835416087934708249_1220 src: /127.0.0.1:48024 dest: /127.0.0.1:54365
2013-10-31 18:37:27,256 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6835416087934708249_1220 to /127.0.0.1:54365
2013-10-31 18:37:27,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6835416087934708249_1220 src: /127.0.0.1:48024 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:37:27,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6835416087934708249_1220 size 238055
2013-10-31 18:37:27,945 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:27,946 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000004_0 not found in cache
2013-10-31 18:37:27,946 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000003_0 not found in cache
2013-10-31 18:37:27,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331047946
2013-10-31 18:37:28,413 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:28,491 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-3539146678558007319_1213
2013-10-31 18:37:28,543 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1540473190 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:28,548 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28505 with signal TERM. Exit code 0
2013-10-31 18:37:28,707 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:28,707 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:28,707 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:28,707 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1540473190 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:28,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:29,268 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_949917260 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:29,279 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28727 with signal TERM. Exit code 0
2013-10-31 18:37:29,442 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:29,442 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:29,442 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:29,442 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_949917260 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:29,746 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-8363873052003505238_1058
2013-10-31 18:37:30,328 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3539146678558007319_1213 file build/test/data/dfs/data/data7/current/blk_-3539146678558007319 for deletion
2013-10-31 18:37:30,328 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3539146678558007319_1213 at file build/test/data/dfs/data/data7/current/blk_-3539146678558007319
2013-10-31 18:37:30,843 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,843 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000000_0 not found in cache
2013-10-31 18:37:30,843 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050843
2013-10-31 18:37:30,862 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,862 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000001_0 not found in cache
2013-10-31 18:37:30,862 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050862
2013-10-31 18:37:30,904 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0021
2013-10-31 18:37:30,904 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0021_m_000002_0 not found in cache
2013-10-31 18:37:30,905 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0021 for user-log deletion with retainTimeStamp:1383331050905
2013-10-31 18:37:31,549 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1495739159 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:31,551 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0021_m_-1217830969 since job job_20131031182606197_0021 is dead
2013-10-31 18:37:31,560 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28500 with signal TERM. Exit code 0
2013-10-31 18:37:31,564 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28507 with signal TERM. Exit code 0
2013-10-31 18:37:31,755 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:31,755 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:31,755 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:31,755 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1495739159 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:31,787 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:31,787 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:31,787 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:31,788 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-1217830969 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:31,836 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000006_0 0.0% setup
2013-10-31 18:37:31,839 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000006_0 is done.
2013-10-31 18:37:31,839 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000006_0 was -1
2013-10-31 18:37:31,840 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:31,847 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000006_0' has completed task_20131031182606197_0022_m_000006 successfully.
2013-10-31 18:37:31,849 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000000_0' to tip task_20131031182606197_0022_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:31,851 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000000
2013-10-31 18:37:31,851 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000001_0' to tip task_20131031182606197_0022_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:31,852 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000001
2013-10-31 18:37:31,854 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:31,855 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:31,855 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000000_0 which needs 1 slots
2013-10-31 18:37:31,855 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000000_0 which needs 1 slots
2013-10-31 18:37:31,856 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000001_0 which needs 1 slots
2013-10-31 18:37:31,856 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0022_m_000001_0 which needs 1 slots
2013-10-31 18:37:31,868 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000002_0' to tip task_20131031182606197_0022_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:31,869 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000002
2013-10-31 18:37:31,869 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000003_0' to tip task_20131031182606197_0022_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:31,870 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000003
2013-10-31 18:37:31,872 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:31,873 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:31,873 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000002_0 which needs 1 slots
2013-10-31 18:37:31,873 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000002_0 which needs 1 slots
2013-10-31 18:37:31,874 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000003_0 which needs 1 slots
2013-10-31 18:37:31,874 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0022_m_000003_0 which needs 1 slots
2013-10-31 18:37:31,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken dst=null perm=null
2013-10-31 18:37:31,882 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50656, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 388992
2013-10-31 18:37:31,886 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0022/attempt_20131031182606197_0022_m_000000_0. Attempting to reuse: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:31,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=null
2013-10-31 18:37:31,889 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43855, bytes: 27712, op: HDFS_READ, cliID: DFSClient_843330289, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 171489
2013-10-31 18:37:31,891 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:31,894 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0021_m_-536120217
2013-10-31 18:37:31,898 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28295 with signal TERM. Exit code 0
2013-10-31 18:37:31,898 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:31,899 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_-480791909 spawned.
2013-10-31 18:37:31,900 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000001_0/taskjvm.sh
2013-10-31 18:37:31,907 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0022_m_000004_0' to tip task_20131031182606197_0022_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:31,907 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0022_m_000004
2013-10-31 18:37:31,908 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:37:31,908 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000004_0 which needs 1 slots
2013-10-31 18:37:31,908 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000004_0 which needs 1 slots
2013-10-31 18:37:31,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022/jobToken dst=null perm=null
2013-10-31 18:37:31,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50659, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8993012588869726418_1226, duration: 129469
2013-10-31 18:37:31,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.xml dst=null perm=null
2013-10-31 18:37:31,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43858, bytes: 27712, op: HDFS_READ, cliID: DFSClient_-1894480040, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_20087189836750365_1223, duration: 166859
2013-10-31 18:37:31,930 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:31,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=null
2013-10-31 18:37:31,943 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43859, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1894480040, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6835416087934708249_1220, duration: 660348
2013-10-31 18:37:31,970 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:31,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.jar dst=null perm=null
2013-10-31 18:37:31,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50664, bytes: 239915, op: HDFS_READ, cliID: DFSClient_843330289, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6835416087934708249_1220, duration: 716706
2013-10-31 18:37:31,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:31,996 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_-1409545061
2013-10-31 18:37:31,997 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_-1409545061 spawned.
2013-10-31 18:37:31,999 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000004_0/taskjvm.sh
2013-10-31 18:37:32,001 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47753, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 204185
2013-10-31 18:37:32,017 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:32,017 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:32,017 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:32,018 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0021_m_-536120217 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:37:32,234 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_1366848033
2013-10-31 18:37:32,235 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_1366848033 spawned.
2013-10-31 18:37:32,236 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000002_0/taskjvm.sh
2013-10-31 18:37:32,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0022_m_959861597
2013-10-31 18:37:32,237 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0022_m_959861597 spawned.
2013-10-31 18:37:32,238 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0022/attempt_20131031182606197_0022_m_000003_0/taskjvm.sh
2013-10-31 18:37:32,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:32,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:32,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:32,635 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48038, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 130964
2013-10-31 18:37:32,640 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000. blk_-9124557202898747765_1227
2013-10-31 18:37:32,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:43865 dest: /127.0.0.1:59471
2013-10-31 18:37:32,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:47757 dest: /127.0.0.1:37740
2013-10-31 18:37:32,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9124557202898747765_1227 src: /127.0.0.1:50670 dest: /127.0.0.1:34578
2013-10-31 18:37:32,664 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50670, dest: /127.0.0.1:34578, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9124557202898747765_1227, duration: 1533595
2013-10-31 18:37:32,664 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,664 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47757, dest: /127.0.0.1:37740, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9124557202898747765_1227, duration: 1893040
2013-10-31 18:37:32,664 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,665 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43865, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 2401434
2013-10-31 18:37:32,665 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9124557202898747765_1227 terminating
2013-10-31 18:37:32,666 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,667 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:32,667 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:32,667 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,668 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9124557202898747765_1227 size 16
2013-10-31 18:37:32,730 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:32,731 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 0.0%
2013-10-31 18:37:32,794 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_-480791909 given task: attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,095 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_-1409545061 given task: attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,172 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_959861597 given task: attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,178 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_1366848033 given task: attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:33,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48046, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7549849351233677898_1221, duration: 174492
2013-10-31 18:37:33,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:33,344 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47766, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 128518
2013-10-31 18:37:33,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,530 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001. blk_6604687767579012569_1228
2013-10-31 18:37:33,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:48052 dest: /127.0.0.1:54365
2013-10-31 18:37:33,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:47770 dest: /127.0.0.1:37740
2013-10-31 18:37:33,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6604687767579012569_1228 src: /127.0.0.1:50683 dest: /127.0.0.1:34578
2013-10-31 18:37:33,572 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50683, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6604687767579012569_1228, duration: 1699662
2013-10-31 18:37:33,572 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,572 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47770, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6604687767579012569_1228, duration: 1948901
2013-10-31 18:37:33,573 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,573 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48052, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6604687767579012569_1228, duration: 2277339
2013-10-31 18:37:33,573 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6604687767579012569_1228 terminating
2013-10-31 18:37:33,575 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,577 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,577 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6604687767579012569_1228 size 8
2013-10-31 18:37:33,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:33,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50684, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000004_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 157491
2013-10-31 18:37:33,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:33,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50687, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000004_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 116780
2013-10-31 18:37:33,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:33,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022/job.split dst=null perm=null
2013-10-31 18:37:33,689 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47776, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7549849351233677898_1221, duration: 168630
2013-10-31 18:37:33,690 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50689, bytes: 1262, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7549849351233677898_1221, duration: 157899
2013-10-31 18:37:33,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:33,728 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50690, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 114012
2013-10-31 18:37:33,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:37:33,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50691, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-677913094566701302_1219, duration: 102943
2013-10-31 18:37:33,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:33,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:33,807 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 from client DFSClient_attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,808 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:33,808 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1203 Total time for transactions(ms): 25Number of transactions batched in Syncs: 109 Number of syncs: 832 SyncTimes(ms): 63288 13925
2013-10-31 18:37:33,852 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,853 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000004_0 0.0%
2013-10-31 18:37:33,912 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003. blk_-4272970350228172538_1231
2013-10-31 18:37:33,912 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002. blk_-6800859378468113558_1231
2013-10-31 18:37:33,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:43889 dest: /127.0.0.1:59471
2013-10-31 18:37:33,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:50693 dest: /127.0.0.1:34578
2013-10-31 18:37:33,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:47782 dest: /127.0.0.1:37740
2013-10-31 18:37:33,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:48066 dest: /127.0.0.1:54365
2013-10-31 18:37:33,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4272970350228172538_1231 src: /127.0.0.1:50696 dest: /127.0.0.1:34578
2013-10-31 18:37:33,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6800859378468113558_1231 src: /127.0.0.1:47785 dest: /127.0.0.1:37740
2013-10-31 18:37:33,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50696, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4272970350228172538_1231, duration: 592109
2013-10-31 18:37:33,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47785, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 2754585
2013-10-31 18:37:33,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47782, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4272970350228172538_1231, duration: 2994972
2013-10-31 18:37:33,941 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,941 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48066, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6800859378468113558_1231, duration: 3174371
2013-10-31 18:37:33,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,941 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43889, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4272970350228172538_1231, duration: 3355272
2013-10-31 18:37:33,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,942 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,941 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4272970350228172538_1231 terminating
2013-10-31 18:37:33,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50693, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0022_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6800859378468113558_1231, duration: 3529923
2013-10-31 18:37:33,942 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6800859378468113558_1231 terminating
2013-10-31 18:37:33,943 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,943 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:33,944 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,944 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,944 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4272970350228172538_1231 size 8
2013-10-31 18:37:33,944 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,944 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:33,975 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,975 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:33,983 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6800859378468113558_1231 size 8
2013-10-31 18:37:33,992 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,992 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000003_0 0.0%
2013-10-31 18:37:33,994 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:33,994 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000002_0 0.0%
2013-10-31 18:37:34,019 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0022_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:37:34,020 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000001_0 0.0%
2013-10-31 18:37:34,859 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000000_0
2013-10-31 18:37:34,859 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000001_0
2013-10-31 18:37:34,876 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000002_0
2013-10-31 18:37:34,876 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000003_0
2013-10-31 18:37:34,912 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0022_m_000004_0
2013-10-31 18:37:35,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0 dst=null perm=null
2013-10-31 18:37:35,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0 dst=null perm=null
2013-10-31 18:37:35,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0 dst=null perm=null
2013-10-31 18:37:35,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000003_0 dst=null perm=null
2013-10-31 18:37:35,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000002_0 dst=null perm=null
2013-10-31 18:37:35,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000001_0 dst=null perm=null
2013-10-31 18:37:35,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0 dst=null perm=null
2013-10-31 18:37:35,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000000_0 dst=null perm=null
2013-10-31 18:37:35,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0 dst=null perm=null
2013-10-31 18:37:35,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:35,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:35,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary/_attempt_20131031182606197_0022_m_000004_0 dst=null perm=null
2013-10-31 18:37:36,228 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:37:36,230 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000001_0 is done.
2013-10-31 18:37:36,230 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000001_0 was -1
2013-10-31 18:37:36,231 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:37:36,520 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:28+2
2013-10-31 18:37:36,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000004_0 is done.
2013-10-31 18:37:36,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000004_0 was -1
2013-10-31 18:37:36,523 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:36,618 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:21+7
2013-10-31 18:37:36,618 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:14+7
2013-10-31 18:37:36,619 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000003_0 is done.
2013-10-31 18:37:36,620 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000003_0 was -1
2013-10-31 18:37:36,620 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000002_0 is done.
2013-10-31 18:37:36,620 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000002_0 was -1
2013-10-31 18:37:36,621 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:37:36,621 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:36,855 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:36,855 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0022_m_000006_0
2013-10-31 18:37:36,855 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000006_0 not found in cache
2013-10-31 18:37:37,863 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000001_0' has completed task_20131031182606197_0022_m_000001 successfully.
2013-10-31 18:37:37,880 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000002_0' has completed task_20131031182606197_0022_m_000002 successfully.
2013-10-31 18:37:37,881 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000003_0' has completed task_20131031182606197_0022_m_000003 successfully.
2013-10-31 18:37:37,916 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000004_0' has completed task_20131031182606197_0022_m_000004 successfully.
2013-10-31 18:37:38,007 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:37:38,011 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:37:38,012 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000000_0 is done.
2013-10-31 18:37:38,013 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000000_0 was -1
2013-10-31 18:37:38,013 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:40,870 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000000_0' has completed task_20131031182606197_0022_m_000000 successfully.
2013-10-31 18:37:40,874 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0022_m_000005_0' to tip task_20131031182606197_0022_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:40,876 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0022_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:40,877 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0022_m_000005_0 which needs 1 slots
2013-10-31 18:37:40,877 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0022_m_000005_0 which needs 1 slots
2013-10-31 18:37:40,911 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0022/attempt_20131031182606197_0022_m_000005_0. Attempting to reuse: jvm_20131031182606197_0022_m_412155634
2013-10-31 18:37:41,543 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0022_m_412155634 given task: attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,637 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000005_0 0.0%
2013-10-31 18:37:41,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary dst=null perm=null
2013-10-31 18:37:41,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:41,649 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS from client DFSClient_attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,649 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0022_m_000005_0
2013-10-31 18:37:41,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,653 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6835416087934708249 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7549849351233677898 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7735072202814239768 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:37:41,654 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:41,655 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_20087189836750365 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:41,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0022 dst=null perm=null
2013-10-31 18:37:43,494 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:43,494 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:44,134 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data4/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:44,134 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data3/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:44,134 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data4/current/blk_-7735072202814239768
2013-10-31 18:37:44,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data3/current/blk_20087189836750365 for deletion
2013-10-31 18:37:44,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data3/current/blk_-7549849351233677898
2013-10-31 18:37:44,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data4/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:44,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data3/current/blk_20087189836750365
2013-10-31 18:37:44,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data4/current/blk_6835416087934708249
2013-10-31 18:37:44,612 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0022_m_000005_0 0.0% cleanup
2013-10-31 18:37:44,614 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0022_m_000005_0 is done.
2013-10-31 18:37:44,614 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0022_m_000005_0 was -1
2013-10-31 18:37:44,615 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:45,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data7/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:45,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data8/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:45,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data7/current/blk_-7735072202814239768
2013-10-31 18:37:45,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data7/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:45,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data8/current/blk_-7549849351233677898
2013-10-31 18:37:45,334 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data7/current/blk_6835416087934708249
2013-10-31 18:37:46,495 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_-7735072202814239768_1222 blk_6835416087934708249_1220
2013-10-31 18:37:46,495 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_20087189836750365_1223 blk_-7549849351233677898_1221 blk_6835416087934708249_1220
2013-10-31 18:37:46,886 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0022_m_000005_0' has completed task_20131031182606197_0022_m_000005 successfully.
2013-10-31 18:37:46,971 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0022 has completed successfully.
2013-10-31 18:37:46,971 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0022,submitTime=1383244643828,launchTime=1383244643925,firstMapTaskLaunchTime=1383244651849,firstJobSetupTaskLaunchTime=1383244645835,firstJobCleanupTaskLaunchTime=1383244660874,finishTime=1383244666970,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=33,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[67B35E38CF3745D68B988F9D0508F6B3/FEE9B5025176410C887F313126C4572F] test/(1/1) ...edpipesplatform/ungrouped
2013-10-31 18:37:46,979 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C. blk_-6648583397754692178_1232
2013-10-31 18:37:46,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:47789 dest: /127.0.0.1:37740
2013-10-31 18:37:46,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:43899 dest: /127.0.0.1:59471
2013-10-31 18:37:46,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6648583397754692178_1232 src: /127.0.0.1:50703 dest: /127.0.0.1:34578
2013-10-31 18:37:46,993 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50703, dest: /127.0.0.1:34578, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6648583397754692178_1232, duration: 4295873
2013-10-31 18:37:46,994 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,994 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43899, dest: /127.0.0.1:59471, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6648583397754692178_1232, duration: 5158502
2013-10-31 18:37:46,994 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,995 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47789, dest: /127.0.0.1:37740, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_874298567, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6648583397754692178_1232, duration: 7000567
2013-10-31 18:37:46,995 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:46,995 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6648583397754692178_1232 terminating
2013-10-31 18:37:46,999 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:47,000 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C from client DFSClient_874298567
2013-10-31 18:37:47,000 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_logs/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C is closed by DFSClient_874298567
2013-10-31 18:37:47,001 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6648583397754692178_1232 size 25809
2013-10-31 18:37:47,008 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0022_1383244643828_hadoop_%5B67B35E38CF3745D68B988F9D0508F6B3%2FFEE9B5025176410C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:47,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000000_0'
2013-10-31 18:37:47,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000001_0'
2013-10-31 18:37:47,009 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000005_0'
2013-10-31 18:37:47,010 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:37:47,010 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000006_0'
2013-10-31 18:37:47,010 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:37:47,011 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8993012588869726418 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:37:47,011 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000004_0'
2013-10-31 18:37:47,011 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:47,012 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0022 being deleted.
2013-10-31 18:37:47,012 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000002_0'
2013-10-31 18:37:47,013 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0022_m_000003_0'
2013-10-31 18:37:47,014 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0022_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:37:47,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0022 dst=null perm=null
2013-10-31 18:37:47,019 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/_temporary
2013-10-31 18:37:47,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=null
2013-10-31 18:37:47,040 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 18:37:47,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000 dst=null perm=null
2013-10-31 18:37:47,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001 dst=null perm=null
2013-10-31 18:37:47,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002 dst=null perm=null
2013-10-31 18:37:47,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003 dst=null perm=null
2013-10-31 18:37:47,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004 dst=null perm=null
2013-10-31 18:37:47,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000 dst=null perm=null
2013-10-31 18:37:47,050 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43902, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 280131
2013-10-31 18:37:47,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001 dst=null perm=null
2013-10-31 18:37:47,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48077, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6604687767579012569_1228, duration: 283693
2013-10-31 18:37:47,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002 dst=null perm=null
2013-10-31 18:37:47,057 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47795, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 260506
2013-10-31 18:37:47,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003 dst=null perm=null
2013-10-31 18:37:47,060 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47796, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4272970350228172538_1231, duration: 260316
2013-10-31 18:37:47,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004 dst=null perm=null
2013-10-31 18:37:47,062 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungrouped
2013-10-31 18:37:47,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped dst=null perm=null
2013-10-31 18:37:47,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00000 dst=null perm=null
2013-10-31 18:37:47,071 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43906, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9124557202898747765_1227, duration: 337155
2013-10-31 18:37:47,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00001 dst=null perm=null
2013-10-31 18:37:47,075 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50710, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6604687767579012569_1228, duration: 266014
2013-10-31 18:37:47,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00002 dst=null perm=null
2013-10-31 18:37:47,079 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47799, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6800859378468113558_1231, duration: 269163
2013-10-31 18:37:47,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00003 dst=null perm=null
2013-10-31 18:37:47,084 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43909, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4272970350228172538_1231, duration: 264186
2013-10-31 18:37:47,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped/part-00004 dst=null perm=null
2013-10-31 18:37:47,108 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:37:47,108 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:37:47,136 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] starting
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second"]
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third"]
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] sink: Hfs["TextDelimited[['ip']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first"]
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] parallel execution is enabled: true
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] starting jobs: 3
2013-10-31 18:37:47,137 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [third] allocating threads: 3
2013-10-31 18:37:47,138 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (1/3) ...latform/chainedtaps/first
2013-10-31 18:37:47,141 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:37:47,141 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:37:47,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:47,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:37:47,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:47,234 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar. blk_-4387391707925617419_1233
2013-10-31 18:37:47,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:50713 dest: /127.0.0.1:34578
2013-10-31 18:37:47,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:47802 dest: /127.0.0.1:37740
2013-10-31 18:37:47,239 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:43912 dest: /127.0.0.1:59471
2013-10-31 18:37:47,252 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3853691654878838440_1011
2013-10-31 18:37:47,252 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43912, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 9763240
2013-10-31 18:37:47,253 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,257 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,356 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47802, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4387391707925617419_1233, duration: 10688483
2013-10-31 18:37:47,356 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,356 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,357 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50713, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4387391707925617419_1233, duration: 114211192
2013-10-31 18:37:47,357 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4387391707925617419_1233 terminating
2013-10-31 18:37:47,359 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar from client DFSClient_-1596270109
2013-10-31 18:37:47,360 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:37:47,360 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:47,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data6/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:47,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data5/current/blk_20087189836750365 for deletion
2013-10-31 18:37:47,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data6/current/blk_-7549849351233677898
2013-10-31 18:37:47,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data5/current/blk_20087189836750365
2013-10-31 18:37:47,864 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data5/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:47,865 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data5/current/blk_6835416087934708249
2013-10-31 18:37:48,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7735072202814239768_1222 file build/test/data/dfs/data/data2/current/blk_-7735072202814239768 for deletion
2013-10-31 18:37:48,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7549849351233677898_1221 file build/test/data/dfs/data/data1/current/blk_-7549849351233677898 for deletion
2013-10-31 18:37:48,261 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_20087189836750365_1223 file build/test/data/dfs/data/data1/current/blk_20087189836750365 for deletion
2013-10-31 18:37:48,262 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6835416087934708249_1220 file build/test/data/dfs/data/data2/current/blk_6835416087934708249 for deletion
2013-10-31 18:37:48,467 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7549849351233677898_1221 at file build/test/data/dfs/data/data1/current/blk_-7549849351233677898
2013-10-31 18:37:48,467 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7735072202814239768_1222 at file build/test/data/dfs/data/data2/current/blk_-7735072202814239768
2013-10-31 18:37:48,468 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_20087189836750365_1223 at file build/test/data/dfs/data/data1/current/blk_20087189836750365
2013-10-31 18:37:48,468 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6835416087934708249_1220 at file build/test/data/dfs/data/data2/current/blk_6835416087934708249
2013-10-31 18:37:48,771 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar. New replication is 10
2013-10-31 18:37:48,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=null
2013-10-31 18:37:48,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,782 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:37:48,786 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:37:48,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:48,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,800 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split. New replication is 10
2013-10-31 18:37:48,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=null
2013-10-31 18:37:48,809 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split. blk_-4526157860798952037_1234
2013-10-31 18:37:48,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:50716 dest: /127.0.0.1:34578
2013-10-31 18:37:48,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:47805 dest: /127.0.0.1:37740
2013-10-31 18:37:48,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:43915 dest: /127.0.0.1:59471
2013-10-31 18:37:48,816 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4526157860798952037_1234 src: /127.0.0.1:48090 dest: /127.0.0.1:54365
2013-10-31 18:37:48,836 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48090, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4526157860798952037_1234, duration: 19166093
2013-10-31 18:37:48,838 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,838 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43915, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4526157860798952037_1234, duration: 3939188
2013-10-31 18:37:48,844 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,845 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,845 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47805, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4526157860798952037_1234, duration: 11223296
2013-10-31 18:37:48,846 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,846 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,846 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50716, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 12256679
2013-10-31 18:37:48,847 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,847 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-4526157860798952037_1234 terminating
2013-10-31 18:37:48,847 INFO datanode.DataNode (FSDataset.java:run(2221)) - Starting asynchronous block report scan
2013-10-31 18:37:48,853 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split from client DFSClient_-1596270109
2013-10-31 18:37:48,854 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split is closed by DFSClient_-1596270109
2013-10-31 18:37:48,854 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4526157860798952037_1234 size 1403
2013-10-31 18:37:48,856 INFO datanode.DataNode (FSDataset.java:run(2224)) - Finished asynchronous block report scan in 6ms
2013-10-31 18:37:48,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,870 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo. blk_-2296380649723109786_1235
2013-10-31 18:37:48,872 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:43917 dest: /127.0.0.1:59471
2013-10-31 18:37:48,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:50721 dest: /127.0.0.1:34578
2013-10-31 18:37:48,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2296380649723109786_1235 src: /127.0.0.1:47810 dest: /127.0.0.1:37740
2013-10-31 18:37:48,878 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47810, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2296380649723109786_1235, duration: 69935
2013-10-31 18:37:48,879 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,879 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50721, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2296380649723109786_1235, duration: 998864
2013-10-31 18:37:48,880 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,880 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43917, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2296380649723109786_1235, duration: 1929153
2013-10-31 18:37:48,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,881 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2296380649723109786_1235 terminating
2013-10-31 18:37:48,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2296380649723109786_1235 size 156
2013-10-31 18:37:48,885 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:37:48,885 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:37:48,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,908 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml. blk_2168431696822472542_1236
2013-10-31 18:37:48,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:50723 dest: /127.0.0.1:34578
2013-10-31 18:37:48,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:43921 dest: /127.0.0.1:59471
2013-10-31 18:37:48,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2168431696822472542_1236 src: /127.0.0.1:47813 dest: /127.0.0.1:37740
2013-10-31 18:37:48,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47813, dest: /127.0.0.1:37740, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2168431696822472542_1236, duration: 258990
2013-10-31 18:37:48,916 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43921, dest: /127.0.0.1:59471, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 1003364
2013-10-31 18:37:48,917 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,917 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50723, dest: /127.0.0.1:34578, bytes: 28401, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 1806584
2013-10-31 18:37:48,918 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1793)) - Reconciled asynchronous block scan with filesystem. 0 blocks concurrently deleted during scan, 2 blocks concurrently added during scan, 0 ongoing creations ignored
2013-10-31 18:37:48,918 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2168431696822472542_1236 terminating
2013-10-31 18:37:48,918 INFO datanode.DataNode (FSDataset.java:reconcileRoughBlockScan(1715)) - Reconciled asynchronous block report against current state in 1 ms
2013-10-31 18:37:48,917 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,921 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml from client DFSClient_-1596270109
2013-10-31 18:37:48,921 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:37:48,928 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,929 INFO hdfs.StateChange (FSNamesystem.java:processReport(3512)) - *BLOCK* NameSystem.processReport: from 127.0.0.1:59471, blocks: 58, processing time: 8 msecs
2013-10-31 18:37:48,929 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2168431696822472542_1236 size 28401
2013-10-31 18:37:48,930 INFO datanode.DataNode (DataNode.java:offerService(1009)) - BlockReport of 58 blocks took 3 msec to generate and 10 msecs for RPC and NN processing
2013-10-31 18:37:48,930 WARN hdfs.StateChange (FSNamesystem.java:addStoredBlock(3690)) - BLOCK* NameSystem.addStoredBlock: Redundant addStoredBlock request received for blk_2168431696822472542_1236 on 127.0.0.1:59471 size 28401
2013-10-31 18:37:48,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=null
2013-10-31 18:37:48,936 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50727, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 399373
2013-10-31 18:37:48,955 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0023: nMaps=4 nReduces=1 max=-1
2013-10-31 18:37:48,955 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0023 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:37:48,955 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0023
2013-10-31 18:37:48,955 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0023 RESULT=SUCCESS
2013-10-31 18:37:48,956 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0023
2013-10-31 18:37:48,957 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0023
2013-10-31 18:37:48,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:48,988 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml. blk_-2588845235276228695_1238
2013-10-31 18:37:48,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:50728 dest: /127.0.0.1:34578
2013-10-31 18:37:48,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:47817 dest: /127.0.0.1:37740
2013-10-31 18:37:48,993 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2588845235276228695_1238 src: /127.0.0.1:43927 dest: /127.0.0.1:59471
2013-10-31 18:37:48,997 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43927, dest: /127.0.0.1:59471, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2588845235276228695_1238, duration: 566302
2013-10-31 18:37:48,998 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:48,998 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:48,998 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47817, dest: /127.0.0.1:37740, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2588845235276228695_1238, duration: 1386322
2013-10-31 18:37:48,999 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:48,999 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50728, dest: /127.0.0.1:34578, bytes: 28466, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2588845235276228695_1238, duration: 2470684
2013-10-31 18:37:48,999 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2588845235276228695_1238 terminating
2013-10-31 18:37:49,002 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml from client DFSClient_-1404978550
2013-10-31 18:37:49,002 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_conf.xml is closed by DFSClient_-1404978550
2013-10-31 18:37:49,003 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:49,003 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2588845235276228695_1238 size 28466
2013-10-31 18:37:49,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:37:49,262 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken. blk_121557755361841184_1239
2013-10-31 18:37:49,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:47819 dest: /127.0.0.1:37740
2013-10-31 18:37:49,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:43929 dest: /127.0.0.1:59471
2013-10-31 18:37:49,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_121557755361841184_1239 src: /127.0.0.1:48104 dest: /127.0.0.1:54365
2013-10-31 18:37:49,270 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48104, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_121557755361841184_1239, duration: 66637
2013-10-31 18:37:49,270 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,271 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43929, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 851903
2013-10-31 18:37:49,271 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,271 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47819, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_121557755361841184_1239, duration: 1696622
2013-10-31 18:37:49,272 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,272 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_121557755361841184_1239 terminating
2013-10-31 18:37:49,274 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,274 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken from client DFSClient_-1596270109
2013-10-31 18:37:49,275 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:37:49,275 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_121557755361841184_1239 size 116
2013-10-31 18:37:49,279 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken
2013-10-31 18:37:49,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.splitmetainfo dst=null perm=null
2013-10-31 18:37:49,284 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47822, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2296380649723109786_1235, duration: 284261
2013-10-31 18:37:49,285 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0023 = 1449. Number of splits = 4
2013-10-31 18:37:49,285 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,285 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,286 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,287 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0023_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:37:49,288 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0023 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:37:49,289 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0023 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:37:49,496 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4387391707925617419_1233 to datanode(s) 127.0.0.1:54365
2013-10-31 18:37:49,496 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_8993012588869726418_1226
2013-10-31 18:37:49,496 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_8993012588869726418_1226
2013-10-31 18:37:50,016 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0023_m_000005_0' to tip task_20131031182606197_0023_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:50,024 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:37:50,024 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000005_0 which needs 1 slots
2013-10-31 18:37:50,025 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000005_0 which needs 1 slots
2013-10-31 18:37:50,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken dst=null perm=null
2013-10-31 18:37:50,033 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43932, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 284802
2013-10-31 18:37:50,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=null
2013-10-31 18:37:50,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43934, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-1069582265, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 439749
2013-10-31 18:37:50,062 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:50,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=null
2013-10-31 18:37:50,089 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43935, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1069582265, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 607562
2013-10-31 18:37:50,135 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data3/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:50,136 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data3/current/blk_8993012588869726418
2013-10-31 18:37:50,159 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:50,164 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29044 with signal TERM. Exit code 0
2013-10-31 18:37:50,164 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_-959828638
2013-10-31 18:37:50,164 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_-959828638 spawned.
2013-10-31 18:37:50,166 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000005_0/taskjvm.sh
2013-10-31 18:37:50,292 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0022_m_-480791909
2013-10-31 18:37:50,553 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:50,553 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:50,553 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:50,553 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_-480791909 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:51,261 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4387391707925617419_1233 to 127.0.0.1:54365
2013-10-31 18:37:51,262 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data1/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:51,263 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data1/current/blk_8993012588869726418
2013-10-31 18:37:51,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4387391707925617419_1233 src: /127.0.0.1:48111 dest: /127.0.0.1:54365
2013-10-31 18:37:51,264 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4387391707925617419_1233 to /127.0.0.1:54365
2013-10-31 18:37:51,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4387391707925617419_1233 src: /127.0.0.1:48111 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:37:51,267 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4387391707925617419_1233 size 238055
2013-10-31 18:37:51,303 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-959828638 given task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:37:51,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:37:52,011 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,012 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000000_0 not found in cache
2013-10-31 18:37:52,012 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000005_0 not found in cache
2013-10-31 18:37:52,012 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,012 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000001_0 not found in cache
2013-10-31 18:37:52,013 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000004_0 not found in cache
2013-10-31 18:37:52,013 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072013
2013-10-31 18:37:52,014 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0022
2013-10-31 18:37:52,014 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072014
2013-10-31 18:37:52,014 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000002_0 not found in cache
2013-10-31 18:37:52,015 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0022_m_000003_0 not found in cache
2013-10-31 18:37:52,015 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0022 for user-log deletion with retainTimeStamp:1383331072015
2013-10-31 18:37:52,095 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_-1409545061 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,105 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29102 with signal TERM. Exit code 0
2013-10-31 18:37:52,189 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_1366848033 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,194 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29133 with signal TERM. Exit code 0
2013-10-31 18:37:52,194 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_959861597 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,201 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29132 with signal TERM. Exit code 0
2013-10-31 18:37:52,320 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,320 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,321 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:52,321 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_-1409545061 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,377 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,377 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,377 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:52,377 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_959861597 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,379 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,380 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,380 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:52,380 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_1366848033 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:37:52,497 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_8993012588869726418_1226
2013-10-31 18:37:52,652 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0022_m_412155634 since job job_20131031182606197_0022 is dead
2013-10-31 18:37:52,661 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group28886 with signal TERM. Exit code 0
2013-10-31 18:37:52,827 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:37:52,828 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:37:52,828 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:37:52,829 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0022_m_412155634 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:37:54,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8993012588869726418_1226 file build/test/data/dfs/data/data7/current/blk_8993012588869726418 for deletion
2013-10-31 18:37:54,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8993012588869726418_1226 at file build/test/data/dfs/data/data7/current/blk_8993012588869726418
2013-10-31 18:37:54,745 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000005_0 0.0% setup
2013-10-31 18:37:54,748 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000005_0 is done.
2013-10-31 18:37:54,749 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000005_0 was -1
2013-10-31 18:37:54,749 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:37:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:37:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,029 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000005_0' has completed task_20131031182606197_0023_m_000005 successfully.
2013-10-31 18:37:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,031 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000000_0' to tip task_20131031182606197_0023_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:37:56,032 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000000
2013-10-31 18:37:56,034 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:37:56,034 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000001_0' to tip task_20131031182606197_0023_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:37:56,034 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000000_0 which needs 1 slots
2013-10-31 18:37:56,034 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000001
2013-10-31 18:37:56,034 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000000_0 which needs 1 slots
2013-10-31 18:37:56,035 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:37:56,035 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000001_0 which needs 1 slots
2013-10-31 18:37:56,035 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000001_0 which needs 1 slots
2013-10-31 18:37:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken dst=null perm=null
2013-10-31 18:37:56,044 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43940, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 151311
2013-10-31 18:37:56,050 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,052 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_-806897
2013-10-31 18:37:56,053 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_-806897 spawned.
2013-10-31 18:37:56,054 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000000_0/taskjvm.sh
2013-10-31 18:37:56,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=null
2013-10-31 18:37:56,056 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:37:56,056 INFO metrics.MetricsSaver (?:flush(?)) - Discard 36 records
2013-10-31 18:37:56,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43942, bytes: 28625, op: HDFS_READ, cliID: DFSClient_168709840, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2168431696822472542_1236, duration: 168140
2013-10-31 18:37:56,067 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000002_0' to tip task_20131031182606197_0023_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:37:56,068 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000002
2013-10-31 18:37:56,069 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:37:56,069 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0023_m_000003_0' to tip task_20131031182606197_0023_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:37:56,069 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000002_0 which needs 1 slots
2013-10-31 18:37:56,069 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000002_0 which needs 1 slots
2013-10-31 18:37:56,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken dst=null perm=null
2013-10-31 18:37:56,072 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0023_m_000003
2013-10-31 18:37:56,074 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:37:56,074 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000003_0 which needs 1 slots
2013-10-31 18:37:56,074 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000003_0 which needs 1 slots
2013-10-31 18:37:56,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43943, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_121557755361841184_1239, duration: 147161
2013-10-31 18:37:56,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023/jobToken dst=null perm=null
2013-10-31 18:37:56,077 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=null
2013-10-31 18:37:56,079 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48119, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_121557755361841184_1239, duration: 173004
2013-10-31 18:37:56,080 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47837, bytes: 28625, op: HDFS_READ, cliID: DFSClient_-2135715500, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2168431696822472542_1236, duration: 170721
2013-10-31 18:37:56,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.xml dst=null perm=null
2013-10-31 18:37:56,084 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50751, bytes: 28625, op: HDFS_READ, cliID: DFSClient_931646476, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2168431696822472542_1236, duration: 166213
2013-10-31 18:37:56,094 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,096 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:37:56,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=null
2013-10-31 18:37:56,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=null
2013-10-31 18:37:56,124 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48123, bytes: 239915, op: HDFS_READ, cliID: DFSClient_168709840, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4387391707925617419_1233, duration: 1370420
2013-10-31 18:37:56,124 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43950, bytes: 239915, op: HDFS_READ, cliID: DFSClient_931646476, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 1297164
2013-10-31 18:37:56,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.jar dst=null perm=null
2013-10-31 18:37:56,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43951, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2135715500, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4387391707925617419_1233, duration: 1719629
2013-10-31 18:37:56,196 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_525620828
2013-10-31 18:37:56,197 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_525620828 spawned.
2013-10-31 18:37:56,199 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000003_0/taskjvm.sh
2013-10-31 18:37:56,201 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_4777009
2013-10-31 18:37:56,202 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_4777009 spawned.
2013-10-31 18:37:56,203 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000001_0/taskjvm.sh
2013-10-31 18:37:56,220 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_m_1805283263
2013-10-31 18:37:56,221 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_m_1805283263 spawned.
2013-10-31 18:37:56,222 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_m_000002_0/taskjvm.sh
2013-10-31 18:37:56,928 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-806897 given task: attempt_20131031182606197_0023_m_000000_0
2013-10-31 18:37:57,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=null
2013-10-31 18:37:57,444 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50757, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 174400
2013-10-31 18:37:57,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:57,483 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48129, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 130611
2013-10-31 18:37:57,703 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_525620828 given task: attempt_20131031182606197_0023_m_000003_0
2013-10-31 18:37:57,714 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_1805283263 given task: attempt_20131031182606197_0023_m_000002_0
2013-10-31 18:37:57,727 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_4777009 given task: attempt_20131031182606197_0023_m_000001_0
2013-10-31 18:37:58,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=null
2013-10-31 18:37:58,199 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:43962, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4526157860798952037_1234, duration: 130985
2013-10-31 18:37:58,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=null
2013-10-31 18:37:58,229 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50766, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4526157860798952037_1234, duration: 172932
2013-10-31 18:37:58,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023/job.split dst=null perm=null
2013-10-31 18:37:58,236 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48138, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4526157860798952037_1234, duration: 137475
2013-10-31 18:37:58,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:58,239 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48139, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 255778
2013-10-31 18:37:58,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:58,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48140, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 206052
2013-10-31 18:37:58,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:37:58,531 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47858, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0023_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 184039
2013-10-31 18:38:00,373 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:38:00,375 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000000_0 is done.
2013-10-31 18:38:00,375 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000000_0 was 54
2013-10-31 18:38:00,375 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,034 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:38:01,034 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0023_m_000005_0
2013-10-31 18:38:01,034 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0023_m_000005_0 not found in cache
2013-10-31 18:38:01,128 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:38:01,129 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000003_0 is done.
2013-10-31 18:38:01,129 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000003_0 was 53
2013-10-31 18:38:01,130 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,157 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:38:01,158 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000002_0 is done.
2013-10-31 18:38:01,159 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000002_0 was 73
2013-10-31 18:38:01,159 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:01,164 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:38:01,165 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000001_0 is done.
2013-10-31 18:38:01,165 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000001_0 was 74
2013-10-31 18:38:01,165 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:02,040 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000000_0' has completed task_20131031182606197_0023_m_000000 successfully.
2013-10-31 18:38:02,304 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0023_r_000000_0' to tip task_20131031182606197_0023_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:02,305 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000003_0' has completed task_20131031182606197_0023_m_000003 successfully.
2013-10-31 18:38:02,306 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:02,307 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_r_000000_0 which needs 1 slots
2013-10-31 18:38:02,307 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_r_000000_0 which needs 1 slots
2013-10-31 18:38:02,308 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000002_0' has completed task_20131031182606197_0023_m_000002 successfully.
2013-10-31 18:38:02,311 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000001_0' has completed task_20131031182606197_0023_m_000001 successfully.
2013-10-31 18:38:02,345 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0023_r_-739234499
2013-10-31 18:38:02,346 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0023_r_-739234499 spawned.
2013-10-31 18:38:02,347 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0023/attempt_20131031182606197_0023_r_000000_0/taskjvm.sh
2013-10-31 18:38:03,150 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_r_-739234499 given task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:08,841 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49809, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000000_0, duration: 10700822
2013-10-31 18:38:08,869 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44852, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000003_0, duration: 12762341
2013-10-31 18:38:08,886 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42177, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000002_0, duration: 12821022
2013-10-31 18:38:08,904 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40157, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0023_m_000001_0, duration: 12829950
2013-10-31 18:38:09,655 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,695 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,757 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:09,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:09,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:09,993 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000. blk_-4840805767582090128_1240
2013-10-31 18:38:10,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:50777 dest: /127.0.0.1:34578
2013-10-31 18:38:10,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:43975 dest: /127.0.0.1:59471
2013-10-31 18:38:10,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4840805767582090128_1240 src: /127.0.0.1:47867 dest: /127.0.0.1:37740
2013-10-31 18:38:10,041 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47867, dest: /127.0.0.1:37740, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4840805767582090128_1240, duration: 1502776
2013-10-31 18:38:10,044 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43975, dest: /127.0.0.1:59471, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 6080313
2013-10-31 18:38:10,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,046 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50777, dest: /127.0.0.1:34578, bytes: 140, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0023_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 7341412
2013-10-31 18:38:10,047 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4840805767582090128_1240 terminating
2013-10-31 18:38:10,047 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,048 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:10,049 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:10,049 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4840805767582090128_1240 size 140
2013-10-31 18:38:10,084 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0023_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:38:10,084 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:11,316 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0023_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:38:11,317 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:12,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0 dst=null perm=null
2013-10-31 18:38:12,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:12,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:12,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary/_attempt_20131031182606197_0023_r_000000_0 dst=null perm=null
2013-10-31 18:38:12,706 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:12,709 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:12,710 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_r_000000_0 is done.
2013-10-31 18:38:12,711 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_r_000000_0 was -1
2013-10-31 18:38:12,711 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:14,321 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_r_000000_0' has completed task_20131031182606197_0023_r_000000 successfully.
2013-10-31 18:38:14,325 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0023_m_000004_0' to tip task_20131031182606197_0023_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:14,329 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0023_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:38:14,330 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0023_m_000004_0 which needs 1 slots
2013-10-31 18:38:14,330 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0023_m_000004_0 which needs 1 slots
2013-10-31 18:38:14,367 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0023/attempt_20131031182606197_0023_m_000004_0. Attempting to reuse: jvm_20131031182606197_0023_m_-806897
2013-10-31 18:38:14,441 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0023_m_-806897 given task: attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,565 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000004_0 0.0%
2013-10-31 18:38:14,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary dst=null perm=null
2013-10-31 18:38:14,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:14,580 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS from client DFSClient_attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,580 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0023_m_000004_0
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4387391707925617419 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:14,584 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4526157860798952037 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2296380649723109786 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:14,585 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2168431696822472542 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:14,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0023 dst=null perm=null
2013-10-31 18:38:16,501 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:16,502 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4387391707925617419_1233 blk_-4526157860798952037_1234
2013-10-31 18:38:17,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data3/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:17,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data3/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:17,145 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data3/current/blk_-4526157860798952037
2013-10-31 18:38:17,146 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data3/current/blk_-4387391707925617419
2013-10-31 18:38:17,520 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0023_m_000004_0 0.0% cleanup
2013-10-31 18:38:17,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0023_m_000004_0 is done.
2013-10-31 18:38:17,522 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0023_m_000004_0 was -1
2013-10-31 18:38:17,522 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data6/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data5/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data6/current/blk_-4526157860798952037
2013-10-31 18:38:17,874 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data5/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data5/current/blk_-4387391707925617419
2013-10-31 18:38:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data6/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data5/current/blk_-2296380649723109786
2013-10-31 18:38:17,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data6/current/blk_2168431696822472542
2013-10-31 18:38:19,330 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:19,330 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0023_r_000000_0
2013-10-31 18:38:19,502 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:19,502 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4387391707925617419_1233 blk_-4526157860798952037_1234 blk_2168431696822472542_1236 blk_-2296380649723109786_1235
2013-10-31 18:38:20,334 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0023_m_000004_0' has completed task_20131031182606197_0023_m_000004 successfully.
2013-10-31 18:38:20,700 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0023 has completed successfully.
2013-10-31 18:38:20,700 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0023,submitTime=1383244668926,launchTime=1383244669288,firstMapTaskLaunchTime=1383244676031,firstReduceTaskLaunchTime=1383244682303,firstJobSetupTaskLaunchTime=1383244670015,firstJobCleanupTaskLaunchTime=1383244694325,finishTime=1383244700700,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/C85A09F2BAB6494E91954F0CB9E4B269] third/(1/3) ...latform/chainedtaps/first
2013-10-31 18:38:20,706 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E. blk_8583745150648525578_1241
2013-10-31 18:38:20,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:50783 dest: /127.0.0.1:34578
2013-10-31 18:38:20,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:48155 dest: /127.0.0.1:54365
2013-10-31 18:38:20,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8583745150648525578_1241 src: /127.0.0.1:47873 dest: /127.0.0.1:37740
2013-10-31 18:38:20,725 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47873, dest: /127.0.0.1:37740, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8583745150648525578_1241, duration: 4468659
2013-10-31 18:38:20,725 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,725 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,726 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48155, dest: /127.0.0.1:54365, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8583745150648525578_1241, duration: 3954039
2013-10-31 18:38:20,727 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,727 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50783, dest: /127.0.0.1:34578, bytes: 28316, op: HDFS_WRITE, cliID: DFSClient_-1404978550, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8583745150648525578_1241, duration: 3757484
2013-10-31 18:38:20,728 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8583745150648525578_1241 terminating
2013-10-31 18:38:20,733 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,734 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E from client DFSClient_-1404978550
2013-10-31 18:38:20,734 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_logs/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E is closed by DFSClient_-1404978550
2013-10-31 18:38:20,735 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8583745150648525578_1241 size 28316
2013-10-31 18:38:20,741 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0023_1383244668926_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2FC85A09F2BAB6494E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:20,742 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000000_0'
2013-10-31 18:38:20,743 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000004_0'
2013-10-31 18:38:20,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000005_0'
2013-10-31 18:38:20,744 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:20,744 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_r_000000_0'
2013-10-31 18:38:20,744 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:20,745 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_121557755361841184 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:20,745 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000002_0'
2013-10-31 18:38:20,745 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000001_0'
2013-10-31 18:38:20,746 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0023_m_000003_0'
2013-10-31 18:38:20,747 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0023_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:20,751 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (2/3) ...atform/chainedtaps/second
2013-10-31 18:38:20,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0023 dst=null perm=null
2013-10-31 18:38:20,757 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:38:20,757 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:38:20,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:20,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:38:20,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:20,779 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar. blk_5873056186943798323_1242
2013-10-31 18:38:20,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:48158 dest: /127.0.0.1:54365
2013-10-31 18:38:20,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:50788 dest: /127.0.0.1:34578
2013-10-31 18:38:20,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:43986 dest: /127.0.0.1:59471
2013-10-31 18:38:20,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43986, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 2854629
2013-10-31 18:38:20,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50788, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5873056186943798323_1242, duration: 3239413
2013-10-31 18:38:20,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48158, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5873056186943798323_1242, duration: 3759534
2013-10-31 18:38:20,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5873056186943798323_1242 terminating
2013-10-31 18:38:20,792 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:20,793 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar from client DFSClient_-1596270109
2013-10-31 18:38:20,793 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:38:20,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:20,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:21,202 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar. New replication is 10
2013-10-31 18:38:21,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=null
2013-10-31 18:38:21,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,217 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:38:21,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first dst=null perm=null
2013-10-31 18:38:21,223 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:38:21,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:38:21,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,238 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split. New replication is 10
2013-10-31 18:38:21,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=null
2013-10-31 18:38:21,246 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split. blk_8427397160063122151_1243
2013-10-31 18:38:21,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:47878 dest: /127.0.0.1:37740
2013-10-31 18:38:21,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:43988 dest: /127.0.0.1:59471
2013-10-31 18:38:21,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:50792 dest: /127.0.0.1:34578
2013-10-31 18:38:21,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8427397160063122151_1243 src: /127.0.0.1:48164 dest: /127.0.0.1:54365
2013-10-31 18:38:21,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48164, dest: /127.0.0.1:54365, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8427397160063122151_1243, duration: 118693
2013-10-31 18:38:21,257 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,257 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50792, dest: /127.0.0.1:34578, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 969660
2013-10-31 18:38:21,258 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,258 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,258 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43988, dest: /127.0.0.1:59471, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8427397160063122151_1243, duration: 2103632
2013-10-31 18:38:21,259 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,259 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47878, dest: /127.0.0.1:37740, bytes: 1551, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8427397160063122151_1243, duration: 3042922
2013-10-31 18:38:21,260 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8427397160063122151_1243 terminating
2013-10-31 18:38:21,262 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,263 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split from client DFSClient_-1596270109
2013-10-31 18:38:21,263 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split is closed by DFSClient_-1596270109
2013-10-31 18:38:21,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8427397160063122151_1243 size 1551
2013-10-31 18:38:21,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,280 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo. blk_6870044034096666232_1244
2013-10-31 18:38:21,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:50794 dest: /127.0.0.1:34578
2013-10-31 18:38:21,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:47883 dest: /127.0.0.1:37740
2013-10-31 18:38:21,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6870044034096666232_1244 src: /127.0.0.1:48167 dest: /127.0.0.1:54365
2013-10-31 18:38:21,288 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48167, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6870044034096666232_1244, duration: 64190
2013-10-31 18:38:21,288 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,288 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47883, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6870044034096666232_1244, duration: 829293
2013-10-31 18:38:21,289 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data2/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:21,289 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50794, dest: /127.0.0.1:34578, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6870044034096666232_1244, duration: 1767671
2013-10-31 18:38:21,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,290 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6870044034096666232_1244 terminating
2013-10-31 18:38:21,292 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,290 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data2/current/blk_-4526157860798952037
2013-10-31 18:38:21,292 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:38:21,289 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data1/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:21,293 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:38:21,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data1/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:21,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data1/current/blk_-4387391707925617419
2013-10-31 18:38:21,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data2/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:21,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data1/current/blk_-2296380649723109786
2013-10-31 18:38:21,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data2/current/blk_2168431696822472542
2013-10-31 18:38:21,295 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6870044034096666232_1244 size 148
2013-10-31 18:38:21,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,317 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml. blk_-4581583629309912568_1245
2013-10-31 18:38:21,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:48168 dest: /127.0.0.1:54365
2013-10-31 18:38:21,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:43995 dest: /127.0.0.1:59471
2013-10-31 18:38:21,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4581583629309912568_1245 src: /127.0.0.1:47887 dest: /127.0.0.1:37740
2013-10-31 18:38:21,325 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47887, dest: /127.0.0.1:37740, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 336637
2013-10-31 18:38:21,325 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,326 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:43995, dest: /127.0.0.1:59471, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4581583629309912568_1245, duration: 1157743
2013-10-31 18:38:21,326 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,327 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48168, dest: /127.0.0.1:54365, bytes: 28616, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 2100471
2013-10-31 18:38:21,327 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4581583629309912568_1245 terminating
2013-10-31 18:38:21,329 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml from client DFSClient_-1596270109
2013-10-31 18:38:21,329 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:38:21,330 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,331 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4581583629309912568_1245 size 28616
2013-10-31 18:38:21,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=null
2013-10-31 18:38:21,344 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48172, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-922529183, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 397216
2013-10-31 18:38:21,362 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0024: nMaps=4 nReduces=1 max=-1
2013-10-31 18:38:21,363 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0024 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:38:21,363 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0024
2013-10-31 18:38:21,363 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0024 RESULT=SUCCESS
2013-10-31 18:38:21,363 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0024
2013-10-31 18:38:21,364 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0024
2013-10-31 18:38:21,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4526157860798952037_1234 file build/test/data/dfs/data/data8/current/blk_-4526157860798952037 for deletion
2013-10-31 18:38:21,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4387391707925617419_1233 file build/test/data/dfs/data/data7/current/blk_-4387391707925617419 for deletion
2013-10-31 18:38:21,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4526157860798952037_1234 at file build/test/data/dfs/data/data8/current/blk_-4526157860798952037
2013-10-31 18:38:21,384 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2296380649723109786_1235 file build/test/data/dfs/data/data7/current/blk_-2296380649723109786 for deletion
2013-10-31 18:38:21,384 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4387391707925617419_1233 at file build/test/data/dfs/data/data7/current/blk_-4387391707925617419
2013-10-31 18:38:21,384 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2168431696822472542_1236 file build/test/data/dfs/data/data8/current/blk_2168431696822472542 for deletion
2013-10-31 18:38:21,384 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2296380649723109786_1235 at file build/test/data/dfs/data/data7/current/blk_-2296380649723109786
2013-10-31 18:38:21,384 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2168431696822472542_1236 at file build/test/data/dfs/data/data8/current/blk_2168431696822472542
2013-10-31 18:38:21,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,392 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml. blk_-5550225210473142444_1247
2013-10-31 18:38:21,393 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:50802 dest: /127.0.0.1:34578
2013-10-31 18:38:21,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:47891 dest: /127.0.0.1:37740
2013-10-31 18:38:21,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5550225210473142444_1247 src: /127.0.0.1:44001 dest: /127.0.0.1:59471
2013-10-31 18:38:21,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44001, dest: /127.0.0.1:59471, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5550225210473142444_1247, duration: 749234
2013-10-31 18:38:21,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,400 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47891, dest: /127.0.0.1:37740, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5550225210473142444_1247, duration: 1092935
2013-10-31 18:38:21,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,401 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50802, dest: /127.0.0.1:34578, bytes: 28681, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5550225210473142444_1247, duration: 1487835
2013-10-31 18:38:21,401 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5550225210473142444_1247 terminating
2013-10-31 18:38:21,403 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,403 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml from client DFSClient_-922529183
2013-10-31 18:38:21,403 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_conf.xml is closed by DFSClient_-922529183
2013-10-31 18:38:21,403 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,404 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5550225210473142444_1247 size 28681
2013-10-31 18:38:21,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:21,551 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken. blk_2225977986120785000_1248
2013-10-31 18:38:21,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:44002 dest: /127.0.0.1:59471
2013-10-31 18:38:21,554 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:50806 dest: /127.0.0.1:34578
2013-10-31 18:38:21,556 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2225977986120785000_1248 src: /127.0.0.1:48178 dest: /127.0.0.1:54365
2013-10-31 18:38:21,559 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48178, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2225977986120785000_1248, duration: 88405
2013-10-31 18:38:21,559 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,559 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50806, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 967024
2013-10-31 18:38:21,560 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,560 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44002, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2225977986120785000_1248, duration: 1926862
2013-10-31 18:38:21,560 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,561 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2225977986120785000_1248 terminating
2013-10-31 18:38:21,566 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,566 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2225977986120785000_1248 size 116
2013-10-31 18:38:21,566 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken from client DFSClient_-1596270109
2013-10-31 18:38:21,567 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:38:21,571 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken
2013-10-31 18:38:21,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.splitmetainfo dst=null perm=null
2013-10-31 18:38:21,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47896, bytes: 152, op: HDFS_READ, cliID: DFSClient_-922529183, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6870044034096666232_1244, duration: 280795
2013-10-31 18:38:21,576 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0024 = 140. Number of splits = 4
2013-10-31 18:38:21,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,577 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,578 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,579 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0024_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:21,580 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0024 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:38:21,580 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0024 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:38:22,503 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_5873056186943798323_1242 to datanode(s) 127.0.0.1:37740
2013-10-31 18:38:22,504 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_121557755361841184_1239
2013-10-31 18:38:22,504 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_121557755361841184_1239
2013-10-31 18:38:23,147 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data4/current/blk_121557755361841184 for deletion
2013-10-31 18:38:23,147 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data4/current/blk_121557755361841184
2013-10-31 18:38:23,749 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0024_m_000005_0' to tip task_20131031182606197_0024_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:23,758 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:38:23,758 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000005_0 which needs 1 slots
2013-10-31 18:38:23,758 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000005_0 which needs 1 slots
2013-10-31 18:38:23,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken dst=null perm=null
2013-10-31 18:38:23,767 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48180, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2225977986120785000_1248, duration: 393090
2013-10-31 18:38:23,767 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 52 raw values into 1 aggregated values, total 2
2013-10-31 18:38:23,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=null
2013-10-31 18:38:23,777 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48182, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-35211420, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4581583629309912568_1245, duration: 381481
2013-10-31 18:38:23,807 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:23,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=null
2013-10-31 18:38:23,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44009, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-35211420, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 1199742
2013-10-31 18:38:23,875 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data6/current/blk_121557755361841184 for deletion
2013-10-31 18:38:23,876 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data6/current/blk_121557755361841184
2013-10-31 18:38:23,934 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0023_m_-959828638
2013-10-31 18:38:23,941 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29474 with signal TERM. Exit code 0
2013-10-31 18:38:23,941 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-278089939
2013-10-31 18:38:23,942 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-278089939 spawned.
2013-10-31 18:38:23,944 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000005_0/taskjvm.sh
2013-10-31 18:38:24,273 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_5873056186943798323_1242 to 127.0.0.1:37740
2013-10-31 18:38:24,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5873056186943798323_1242 src: /127.0.0.1:47901 dest: /127.0.0.1:37740
2013-10-31 18:38:24,275 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_5873056186943798323_1242 to /127.0.0.1:37740
2013-10-31 18:38:24,566 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5873056186943798323_1242 src: /127.0.0.1:47901 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:38:24,567 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5873056186943798323_1242 size 238055
2013-10-31 18:38:24,637 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:24,637 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:24,637 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:24,637 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_-959828638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:25,369 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-278089939 given task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:25,504 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_121557755361841184_1239
2013-10-31 18:38:25,745 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,745 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0023_m_000004_0 not found in cache
2013-10-31 18:38:25,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105746
2013-10-31 18:38:25,746 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,746 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105746
2013-10-31 18:38:25,747 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105747
2013-10-31 18:38:25,747 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0023
2013-10-31 18:38:25,748 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0023 for user-log deletion with retainTimeStamp:1383331105748
2013-10-31 18:38:25,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:26,758 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_r_-739234499 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:26,769 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29905 with signal TERM. Exit code 0
2013-10-31 18:38:26,942 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:26,942 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:26,942 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:26,942 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_r_-739234499 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,061 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_-806897 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,071 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29629 with signal TERM. Exit code 0
2013-10-31 18:38:27,203 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_525620828 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,213 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29698 with signal TERM. Exit code 0
2013-10-31 18:38:27,224 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_1805283263 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,235 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29704 with signal TERM. Exit code 0
2013-10-31 18:38:27,238 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0023_m_4777009 since job job_20131031182606197_0023 is dead
2013-10-31 18:38:27,247 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group29703 with signal TERM. Exit code 0
2013-10-31 18:38:27,255 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,255 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,255 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:27,255 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_-806897 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:38:27,346 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_121557755361841184_1239 file build/test/data/dfs/data/data8/current/blk_121557755361841184 for deletion
2013-10-31 18:38:27,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_121557755361841184_1239 at file build/test/data/dfs/data/data8/current/blk_121557755361841184
2013-10-31 18:38:27,423 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,424 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,424 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:27,424 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_525620828 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,440 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,441 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,441 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:27,441 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_1805283263 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:27,460 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:27,460 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:27,460 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:27,460 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0023_m_4777009 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:38:28,839 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000005_0 0.0% setup
2013-10-31 18:38:28,844 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000005_0 is done.
2013-10-31 18:38:28,844 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000005_0 was -1
2013-10-31 18:38:28,845 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:29,811 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000005_0' has completed task_20131031182606197_0024_m_000005 successfully.
2013-10-31 18:38:29,814 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000000_0' to tip task_20131031182606197_0024_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:29,815 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000000
2013-10-31 18:38:29,817 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:29,817 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000000_0 which needs 1 slots
2013-10-31 18:38:29,817 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000000_0 which needs 1 slots
2013-10-31 18:38:29,851 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-829914259
2013-10-31 18:38:29,852 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-829914259 spawned.
2013-10-31 18:38:29,855 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000000_0/taskjvm.sh
2013-10-31 18:38:30,942 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-829914259 given task: attempt_20131031182606197_0024_m_000000_0
2013-10-31 18:38:31,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=null
2013-10-31 18:38:31,464 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50818, bytes: 1567, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 170879
2013-10-31 18:38:31,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:38:31,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44016, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 1039473
2013-10-31 18:38:32,770 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000001_0' to tip task_20131031182606197_0024_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:38:32,771 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000001
2013-10-31 18:38:32,773 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:38:32,773 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000002_0' to tip task_20131031182606197_0024_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:38:32,773 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000001_0 which needs 1 slots
2013-10-31 18:38:32,774 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000002
2013-10-31 18:38:32,774 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000001_0 which needs 1 slots
2013-10-31 18:38:32,776 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:38:32,776 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000002_0 which needs 1 slots
2013-10-31 18:38:32,776 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000002_0 which needs 1 slots
2013-10-31 18:38:32,777 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0024_m_000003_0' to tip task_20131031182606197_0024_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:38:32,777 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0024_m_000003
2013-10-31 18:38:32,779 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:38:32,779 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000003_0 which needs 1 slots
2013-10-31 18:38:32,780 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000003_0 which needs 1 slots
2013-10-31 18:38:32,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken dst=null perm=null
2013-10-31 18:38:32,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken dst=null perm=null
2013-10-31 18:38:32,785 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50820, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 374755
2013-10-31 18:38:32,789 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50821, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 301900
2013-10-31 18:38:32,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=null
2013-10-31 18:38:32,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=null
2013-10-31 18:38:32,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47912, bytes: 28840, op: HDFS_READ, cliID: DFSClient_-1332272270, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 374948
2013-10-31 18:38:32,801 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44022, bytes: 28840, op: HDFS_READ, cliID: DFSClient_12452885, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4581583629309912568_1245, duration: 417796
2013-10-31 18:38:32,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024/jobToken dst=null perm=null
2013-10-31 18:38:32,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50826, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2225977986120785000_1248, duration: 277044
2013-10-31 18:38:32,831 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,831 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.xml dst=null perm=null
2013-10-31 18:38:32,838 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47916, bytes: 28840, op: HDFS_READ, cliID: DFSClient_20886102, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4581583629309912568_1245, duration: 391532
2013-10-31 18:38:32,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=null
2013-10-31 18:38:32,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=null
2013-10-31 18:38:32,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48200, bytes: 239915, op: HDFS_READ, cliID: DFSClient_12452885, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5873056186943798323_1242, duration: 743607
2013-10-31 18:38:32,868 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44027, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1332272270, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5873056186943798323_1242, duration: 1350739
2013-10-31 18:38:32,869 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:32,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.jar dst=null perm=null
2013-10-31 18:38:32,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50831, bytes: 239915, op: HDFS_READ, cliID: DFSClient_20886102, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5873056186943798323_1242, duration: 593297
2013-10-31 18:38:32,915 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_1142792948
2013-10-31 18:38:32,916 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_1142792948 spawned.
2013-10-31 18:38:32,917 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000002_0/taskjvm.sh
2013-10-31 18:38:32,930 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-1073228223
2013-10-31 18:38:32,931 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-1073228223 spawned.
2013-10-31 18:38:32,932 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000001_0/taskjvm.sh
2013-10-31 18:38:32,944 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_m_-1355604951
2013-10-31 18:38:32,945 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_m_-1355604951 spawned.
2013-10-31 18:38:32,946 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_m_000003_0/taskjvm.sh
2013-10-31 18:38:34,390 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:0+35
2013-10-31 18:38:34,392 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000000_0 is done.
2013-10-31 18:38:34,392 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000000_0 was 6
2013-10-31 18:38:34,392 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:34,556 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_1142792948 given task: attempt_20131031182606197_0024_m_000002_0
2013-10-31 18:38:34,648 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-1073228223 given task: attempt_20131031182606197_0024_m_000001_0
2013-10-31 18:38:34,673 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-1355604951 given task: attempt_20131031182606197_0024_m_000003_0
2013-10-31 18:38:34,817 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:34,818 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0024_m_000005_0
2013-10-31 18:38:34,818 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0024_m_000005_0 not found in cache
2013-10-31 18:38:35,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=null
2013-10-31 18:38:35,051 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44036, bytes: 1051, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8427397160063122151_1243, duration: 195981
2013-10-31 18:38:35,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:38:35,090 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50841, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 138209
2013-10-31 18:38:35,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=null
2013-10-31 18:38:35,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47931, bytes: 1567, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8427397160063122151_1243, duration: 160168
2013-10-31 18:38:35,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:38:35,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44041, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4840805767582090128_1240, duration: 108959
2013-10-31 18:38:35,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024/job.split dst=null perm=null
2013-10-31 18:38:35,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50845, bytes: 535, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8427397160063122151_1243, duration: 143643
2013-10-31 18:38:35,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:38:35,240 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50846, bytes: 144, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0024_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4840805767582090128_1240, duration: 133109
2013-10-31 18:38:35,823 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000000_0' has completed task_20131031182606197_0024_m_000000 successfully.
2013-10-31 18:38:35,825 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0024_r_000000_0' to tip task_20131031182606197_0024_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:35,828 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:38:35,828 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_r_000000_0 which needs 1 slots
2013-10-31 18:38:35,828 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_r_000000_0 which needs 1 slots
2013-10-31 18:38:35,866 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0024_r_-740270901
2013-10-31 18:38:35,867 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0024_r_-740270901 spawned.
2013-10-31 18:38:35,868 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0024/attempt_20131031182606197_0024_r_000000_0/taskjvm.sh
2013-10-31 18:38:36,755 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_r_-740270901 given task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:37,981 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:70+35
2013-10-31 18:38:37,984 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000002_0 is done.
2013-10-31 18:38:37,984 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000002_0 was 29
2013-10-31 18:38:37,985 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,076 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:35+35
2013-10-31 18:38:38,078 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000001_0 is done.
2013-10-31 18:38:38,079 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000001_0 was 6
2013-10-31 18:38:38,079 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,130 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000:105+35
2013-10-31 18:38:38,132 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000003_0 is done.
2013-10-31 18:38:38,132 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000003_0 was 51
2013-10-31 18:38:38,132 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:38,780 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000001_0' has completed task_20131031182606197_0024_m_000001 successfully.
2013-10-31 18:38:38,783 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000002_0' has completed task_20131031182606197_0024_m_000002 successfully.
2013-10-31 18:38:38,785 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000003_0' has completed task_20131031182606197_0024_m_000003 successfully.
2013-10-31 18:38:42,430 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49885, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000000_0, duration: 8637538
2013-10-31 18:38:42,452 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:44928, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000001_0, duration: 8544273
2013-10-31 18:38:42,466 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42253, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000002_0, duration: 10321335
2013-10-31 18:38:42,483 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40233, bytes: 51, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0024_m_000003_0, duration: 12445165
2013-10-31 18:38:43,232 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,273 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,323 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:43,531 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1304 Total time for transactions(ms): 28Number of transactions batched in Syncs: 120 Number of syncs: 905 SyncTimes(ms): 65667 14454
2013-10-31 18:38:43,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:43,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:43,562 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000. blk_298656553194616881_1249
2013-10-31 18:38:43,598 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:50854 dest: /127.0.0.1:34578
2013-10-31 18:38:43,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:44052 dest: /127.0.0.1:59471
2013-10-31 18:38:43,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_298656553194616881_1249 src: /127.0.0.1:47944 dest: /127.0.0.1:37740
2013-10-31 18:38:43,603 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47944, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 1518337
2013-10-31 18:38:43,604 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,604 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44052, dest: /127.0.0.1:59471, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_298656553194616881_1249, duration: 2675780
2013-10-31 18:38:43,604 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,604 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50854, dest: /127.0.0.1:34578, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0024_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_298656553194616881_1249, duration: 3103341
2013-10-31 18:38:43,605 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_298656553194616881_1249 terminating
2013-10-31 18:38:43,607 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,607 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:43,607 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:43,608 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_298656553194616881_1249 size 41
2013-10-31 18:38:43,642 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0024_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:38:43,643 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:38:44,836 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0024_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:38:44,838 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:45,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0 dst=null perm=null
2013-10-31 18:38:45,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:45,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:45,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary/_attempt_20131031182606197_0024_r_000000_0 dst=null perm=null
2013-10-31 18:38:46,286 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:46,288 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_r_000000_0 1.0% reduce > reduce
2013-10-31 18:38:46,289 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_r_000000_0 is done.
2013-10-31 18:38:46,290 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_r_000000_0 was -1
2013-10-31 18:38:46,290 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:47,841 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_r_000000_0' has completed task_20131031182606197_0024_r_000000 successfully.
2013-10-31 18:38:47,845 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0024_m_000004_0' to tip task_20131031182606197_0024_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:38:47,847 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0024_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:38:47,848 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0024_m_000004_0 which needs 1 slots
2013-10-31 18:38:47,848 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0024_m_000004_0 which needs 1 slots
2013-10-31 18:38:47,885 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0024/attempt_20131031182606197_0024_m_000004_0. Attempting to reuse: jvm_20131031182606197_0024_m_-278089939
2013-10-31 18:38:48,923 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0024_m_-278089939 given task: attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,031 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000004_0 0.0%
2013-10-31 18:38:49,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary dst=null perm=null
2013-10-31 18:38:49,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:49,055 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS from client DFSClient_attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,055 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0024_m_000004_0
2013-10-31 18:38:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,063 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5873056186943798323 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8427397160063122151 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6870044034096666232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:49,064 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:38:49,065 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4581583629309912568 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:49,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0024 dst=null perm=null
2013-10-31 18:38:49,508 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_5873056186943798323_1242
2013-10-31 18:38:49,508 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_8427397160063122151_1243 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:50,884 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data6/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:50,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data6/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:50,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data6/current/blk_-4581583629309912568
2013-10-31 18:38:50,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data5/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:50,885 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data6/current/blk_5873056186943798323
2013-10-31 18:38:50,886 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data5/current/blk_8427397160063122151
2013-10-31 18:38:51,282 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data2/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:51,282 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data2/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:51,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data2/current/blk_5873056186943798323
2013-10-31 18:38:51,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data1/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:51,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data2/current/blk_6870044034096666232
2013-10-31 18:38:51,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data1/current/blk_8427397160063122151
2013-10-31 18:38:52,002 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0024_m_000004_0 0.0% cleanup
2013-10-31 18:38:52,004 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0024_m_000004_0 is done.
2013-10-31 18:38:52,004 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0024_m_000004_0 was -1
2013-10-31 18:38:52,004 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:38:52,509 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:52,509 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_8427397160063122151_1243 blk_6870044034096666232_1244 blk_-4581583629309912568_1245 blk_5873056186943798323_1242
2013-10-31 18:38:52,848 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:52,848 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0024_r_000000_0
2013-10-31 18:38:53,157 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data4/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:53,157 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data3/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:53,157 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data4/current/blk_-4581583629309912568
2013-10-31 18:38:53,157 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data3/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:53,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data3/current/blk_5873056186943798323
2013-10-31 18:38:53,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data4/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:53,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data3/current/blk_6870044034096666232
2013-10-31 18:38:53,159 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data4/current/blk_8427397160063122151
2013-10-31 18:38:53,854 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0024_m_000004_0' has completed task_20131031182606197_0024_m_000004 successfully.
2013-10-31 18:38:53,855 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0024 has completed successfully.
2013-10-31 18:38:53,855 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0024,submitTime=1383244701334,launchTime=1383244701580,firstMapTaskLaunchTime=1383244709814,firstReduceTaskLaunchTime=1383244715825,firstJobSetupTaskLaunchTime=1383244703749,firstJobCleanupTaskLaunchTime=1383244727845,finishTime=1383244733855,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/9C5FB226814F42F591262ADB67462D7D] third/(2/3) ...atform/chainedtaps/second
2013-10-31 18:38:53,860 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5. blk_-2768714479833497585_1250
2013-10-31 18:38:53,862 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:50859 dest: /127.0.0.1:34578
2013-10-31 18:38:53,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:44057 dest: /127.0.0.1:59471
2013-10-31 18:38:53,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2768714479833497585_1250 src: /127.0.0.1:48232 dest: /127.0.0.1:54365
2013-10-31 18:38:53,876 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48232, dest: /127.0.0.1:54365, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2768714479833497585_1250, duration: 5489475
2013-10-31 18:38:53,876 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,876 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44057, dest: /127.0.0.1:59471, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2768714479833497585_1250, duration: 3594489
2013-10-31 18:38:53,877 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,877 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50859, dest: /127.0.0.1:34578, bytes: 28080, op: HDFS_WRITE, cliID: DFSClient_-922529183, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2768714479833497585_1250, duration: 5177988
2013-10-31 18:38:53,877 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,878 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2768714479833497585_1250 terminating
2013-10-31 18:38:53,880 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 from client DFSClient_-922529183
2013-10-31 18:38:53,880 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_logs/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 is closed by DFSClient_-922529183
2013-10-31 18:38:53,881 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,881 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2768714479833497585_1250 size 28080
2013-10-31 18:38:53,886 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0024_1383244701334_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F9C5FB226814F42F5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:53,886 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000000_0'
2013-10-31 18:38:53,887 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000004_0'
2013-10-31 18:38:53,887 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000005_0'
2013-10-31 18:38:53,887 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_r_000000_0'
2013-10-31 18:38:53,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:38:53,888 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:38:53,889 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2225977986120785000 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:38:53,892 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] starting step: (3/3) ...latform/chainedtaps/third
2013-10-31 18:38:53,892 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0024_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:38:53,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0024 dst=null perm=null
2013-10-31 18:38:53,899 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:38:53,899 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:38:53,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:53,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:38:53,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:53,921 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar. blk_-5088351345251133232_1251
2013-10-31 18:38:53,922 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:47951 dest: /127.0.0.1:37740
2013-10-31 18:38:53,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:50864 dest: /127.0.0.1:34578
2013-10-31 18:38:53,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:48236 dest: /127.0.0.1:54365
2013-10-31 18:38:53,942 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48236, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5088351345251133232_1251, duration: 6771556
2013-10-31 18:38:53,943 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,943 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,943 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50864, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 7681197
2013-10-31 18:38:53,943 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,944 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,944 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47951, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5088351345251133232_1251, duration: 8757559
2013-10-31 18:38:53,945 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5088351345251133232_1251 terminating
2013-10-31 18:38:53,946 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:53,946 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar from client DFSClient_-1596270109
2013-10-31 18:38:53,947 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:38:53,952 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar. New replication is 10
2013-10-31 18:38:53,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=null
2013-10-31 18:38:53,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:53,964 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:38:53,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second dst=null perm=null
2013-10-31 18:38:53,969 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:38:53,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:38:54,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,344 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split. New replication is 10
2013-10-31 18:38:54,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=null
2013-10-31 18:38:54,350 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split. blk_2159410241161564090_1252
2013-10-31 18:38:54,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:44063 dest: /127.0.0.1:59471
2013-10-31 18:38:54,353 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:48238 dest: /127.0.0.1:54365
2013-10-31 18:38:54,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:50868 dest: /127.0.0.1:34578
2013-10-31 18:38:54,355 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4581583629309912568_1245 file build/test/data/dfs/data/data7/current/blk_-4581583629309912568 for deletion
2013-10-31 18:38:54,356 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5873056186943798323_1242 file build/test/data/dfs/data/data7/current/blk_5873056186943798323 for deletion
2013-10-31 18:38:54,356 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4581583629309912568_1245 at file build/test/data/dfs/data/data7/current/blk_-4581583629309912568
2013-10-31 18:38:54,356 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6870044034096666232_1244 file build/test/data/dfs/data/data8/current/blk_6870044034096666232 for deletion
2013-10-31 18:38:54,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5873056186943798323_1242 at file build/test/data/dfs/data/data7/current/blk_5873056186943798323
2013-10-31 18:38:54,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8427397160063122151_1243 file build/test/data/dfs/data/data7/current/blk_8427397160063122151 for deletion
2013-10-31 18:38:54,357 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2159410241161564090_1252 src: /127.0.0.1:47957 dest: /127.0.0.1:37740
2013-10-31 18:38:54,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8427397160063122151_1243 at file build/test/data/dfs/data/data7/current/blk_8427397160063122151
2013-10-31 18:38:54,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6870044034096666232_1244 at file build/test/data/dfs/data/data8/current/blk_6870044034096666232
2013-10-31 18:38:54,360 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47957, dest: /127.0.0.1:37740, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2159410241161564090_1252, duration: 84717
2013-10-31 18:38:54,361 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,361 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50868, dest: /127.0.0.1:34578, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2159410241161564090_1252, duration: 853762
2013-10-31 18:38:54,362 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,362 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48238, dest: /127.0.0.1:54365, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2159410241161564090_1252, duration: 1794434
2013-10-31 18:38:54,362 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,363 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,363 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44063, dest: /127.0.0.1:59471, bytes: 1555, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2159410241161564090_1252, duration: 2613244
2013-10-31 18:38:54,363 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_2159410241161564090_1252 terminating
2013-10-31 18:38:54,363 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,366 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,366 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split from client DFSClient_-1596270109
2013-10-31 18:38:54,367 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split is closed by DFSClient_-1596270109
2013-10-31 18:38:54,367 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2159410241161564090_1252 size 1555
2013-10-31 18:38:54,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,382 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo. blk_4561088021142520977_1253
2013-10-31 18:38:54,384 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:48241 dest: /127.0.0.1:54365
2013-10-31 18:38:54,386 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:47959 dest: /127.0.0.1:37740
2013-10-31 18:38:54,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4561088021142520977_1253 src: /127.0.0.1:50872 dest: /127.0.0.1:34578
2013-10-31 18:38:54,390 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50872, dest: /127.0.0.1:34578, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4561088021142520977_1253, duration: 68602
2013-10-31 18:38:54,390 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,391 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47959, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4561088021142520977_1253, duration: 831193
2013-10-31 18:38:54,391 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,392 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48241, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4561088021142520977_1253, duration: 1813672
2013-10-31 18:38:54,392 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4561088021142520977_1253 terminating
2013-10-31 18:38:54,394 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,394 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:38:54,395 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:38:54,395 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,396 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4561088021142520977_1253 size 148
2013-10-31 18:38:54,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,417 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml. blk_8650378453195215803_1254
2013-10-31 18:38:54,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:50873 dest: /127.0.0.1:34578
2013-10-31 18:38:54,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:44071 dest: /127.0.0.1:59471
2013-10-31 18:38:54,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8650378453195215803_1254 src: /127.0.0.1:47963 dest: /127.0.0.1:37740
2013-10-31 18:38:54,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47963, dest: /127.0.0.1:37740, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8650378453195215803_1254, duration: 95203
2013-10-31 18:38:54,425 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44071, dest: /127.0.0.1:59471, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8650378453195215803_1254, duration: 910674
2013-10-31 18:38:54,426 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,427 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50873, dest: /127.0.0.1:34578, bytes: 28684, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 1836208
2013-10-31 18:38:54,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8650378453195215803_1254 terminating
2013-10-31 18:38:54,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,431 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml from client DFSClient_-1596270109
2013-10-31 18:38:54,431 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:38:54,431 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,432 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8650378453195215803_1254 size 28684
2013-10-31 18:38:54,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=null
2013-10-31 18:38:54,447 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50877, bytes: 28912, op: HDFS_READ, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 389758
2013-10-31 18:38:54,465 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0025: nMaps=4 nReduces=1 max=-1
2013-10-31 18:38:54,466 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0025 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:38:54,466 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0025
2013-10-31 18:38:54,466 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0025 RESULT=SUCCESS
2013-10-31 18:38:54,466 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0025
2013-10-31 18:38:54,467 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [third] submitted hadoop job: job_20131031182606197_0025
2013-10-31 18:38:54,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,486 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml. blk_-2612740665432172558_1256
2013-10-31 18:38:54,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:44075 dest: /127.0.0.1:59471
2013-10-31 18:38:54,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:50879 dest: /127.0.0.1:34578
2013-10-31 18:38:54,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2612740665432172558_1256 src: /127.0.0.1:47968 dest: /127.0.0.1:37740
2013-10-31 18:38:54,492 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47968, dest: /127.0.0.1:37740, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2612740665432172558_1256, duration: 2029052
2013-10-31 18:38:54,492 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,492 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50879, dest: /127.0.0.1:34578, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2612740665432172558_1256, duration: 1181641
2013-10-31 18:38:54,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,493 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44075, dest: /127.0.0.1:59471, bytes: 28749, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2612740665432172558_1256, duration: 2595505
2013-10-31 18:38:54,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2612740665432172558_1256 terminating
2013-10-31 18:38:54,495 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,496 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,496 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2612740665432172558_1256 size 28749
2013-10-31 18:38:54,895 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml from client DFSClient_1105674743
2013-10-31 18:38:54,896 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_conf.xml is closed by DFSClient_1105674743
2013-10-31 18:38:54,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:38:54,910 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken. blk_-3693249760350606050_1257
2013-10-31 18:38:54,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:48253 dest: /127.0.0.1:54365
2013-10-31 18:38:54,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:50883 dest: /127.0.0.1:34578
2013-10-31 18:38:54,916 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3693249760350606050_1257 src: /127.0.0.1:47972 dest: /127.0.0.1:37740
2013-10-31 18:38:54,919 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:47972, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 69137
2013-10-31 18:38:54,919 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,919 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50883, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3693249760350606050_1257, duration: 907968
2013-10-31 18:38:54,920 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,920 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,920 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48253, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3693249760350606050_1257, duration: 1930642
2013-10-31 18:38:54,921 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3693249760350606050_1257 terminating
2013-10-31 18:38:54,923 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,924 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken from client DFSClient_-1596270109
2013-10-31 18:38:54,924 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:38:54,924 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3693249760350606050_1257 size 116
2013-10-31 18:38:54,929 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken
2013-10-31 18:38:54,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.splitmetainfo dst=null perm=null
2013-10-31 18:38:54,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50885, bytes: 152, op: HDFS_READ, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4561088021142520977_1253, duration: 270403
2013-10-31 18:38:54,935 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0025 = 41. Number of splits = 4
2013-10-31 18:38:54,935 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,935 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,936 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,937 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,938 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0025_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:38:54,938 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0025 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:38:54,939 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0025 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:38:55,510 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-5088351345251133232_1251 to datanode(s) 127.0.0.1:59471
2013-10-31 18:38:55,510 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_2225977986120785000_1248
2013-10-31 18:38:55,511 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_2225977986120785000_1248
2013-10-31 18:38:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:38:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,030 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,051 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:38:56,051 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:38:56,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data3/current/blk_2225977986120785000 for deletion
2013-10-31 18:38:56,158 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data3/current/blk_2225977986120785000
2013-10-31 18:38:56,804 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0025_m_000005_0' to tip task_20131031182606197_0025_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:38:56,809 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000001_0'
2013-10-31 18:38:56,811 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000002_0'
2013-10-31 18:38:56,812 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:38:56,812 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000005_0 which needs 1 slots
2013-10-31 18:38:56,813 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0024_m_000003_0'
2013-10-31 18:38:56,813 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000005_0 which needs 1 slots
2013-10-31 18:38:56,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken dst=null perm=null
2013-10-31 18:38:56,822 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48257, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3693249760350606050_1257, duration: 301852
2013-10-31 18:38:56,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=null
2013-10-31 18:38:56,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44085, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-878761968, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8650378453195215803_1254, duration: 382638
2013-10-31 18:38:56,858 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:38:56,888 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data6/current/blk_2225977986120785000 for deletion
2013-10-31 18:38:56,889 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data6/current/blk_2225977986120785000
2013-10-31 18:38:56,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=null
2013-10-31 18:38:56,910 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50889, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-878761968, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 1453314
2013-10-31 18:38:57,007 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_892861919
2013-10-31 18:38:57,008 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_892861919 spawned.
2013-10-31 18:38:57,009 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000005_0/taskjvm.sh
2013-10-31 18:38:57,357 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-5088351345251133232_1251 to 127.0.0.1:59471
2013-10-31 18:38:57,359 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5088351345251133232_1251 src: /127.0.0.1:44087 dest: /127.0.0.1:59471
2013-10-31 18:38:57,359 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-5088351345251133232_1251 to /127.0.0.1:59471
2013-10-31 18:38:57,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-5088351345251133232_1251 src: /127.0.0.1:44087 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:38:57,367 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5088351345251133232_1251 size 238055
2013-10-31 18:38:58,140 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_892861919 given task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:38:58,511 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_2225977986120785000_1248
2013-10-31 18:38:58,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:38:58,889 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:38:58,889 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0024_m_000004_0 not found in cache
2013-10-31 18:38:58,889 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331138889
2013-10-31 18:38:58,955 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-829914259 since job job_20131031182606197_0024 is dead
2013-10-31 18:38:58,965 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30249 with signal TERM. Exit code 0
2013-10-31 18:38:59,166 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:38:59,166 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:38:59,166 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:38:59,166 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-829914259 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:00,041 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-278089939 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:00,049 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30109 with signal TERM. Exit code 0
2013-10-31 18:39:00,226 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:00,226 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:00,226 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:00,226 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-278089939 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:39:00,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2225977986120785000_1248 file build/test/data/dfs/data/data2/current/blk_2225977986120785000 for deletion
2013-10-31 18:39:00,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2225977986120785000_1248 at file build/test/data/dfs/data/data2/current/blk_2225977986120785000
2013-10-31 18:39:00,336 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_r_-740270901 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:00,346 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30534 with signal TERM. Exit code 0
2013-10-31 18:39:00,540 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:00,540 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:00,540 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:00,540 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_r_-740270901 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:01,556 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000005_0 0.0% setup
2013-10-31 18:39:01,559 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000005_0 is done.
2013-10-31 18:39:01,560 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000005_0 was -1
2013-10-31 18:39:01,560 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:01,813 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,813 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,813 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0024
2013-10-31 18:39:01,814 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141813
2013-10-31 18:39:01,814 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141814
2013-10-31 18:39:01,814 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0024 for user-log deletion with retainTimeStamp:1383331141814
2013-10-31 18:39:02,567 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_1142792948 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,578 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30368 with signal TERM. Exit code 0
2013-10-31 18:39:02,660 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-1073228223 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,668 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30399 with signal TERM. Exit code 0
2013-10-31 18:39:02,711 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0024_m_-1355604951 since job job_20131031182606197_0024 is dead
2013-10-31 18:39:02,719 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30398 with signal TERM. Exit code 0
2013-10-31 18:39:02,791 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,791 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,791 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:02,791 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_1142792948 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,817 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000005_0' has completed task_20131031182606197_0025_m_000005 successfully.
2013-10-31 18:39:02,818 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000000_0' to tip task_20131031182606197_0025_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:02,819 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000000
2013-10-31 18:39:02,820 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:02,820 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000001_0' to tip task_20131031182606197_0025_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:39:02,820 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000000_0 which needs 1 slots
2013-10-31 18:39:02,820 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000000_0 which needs 1 slots
2013-10-31 18:39:02,820 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000001
2013-10-31 18:39:02,821 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000002_0' to tip task_20131031182606197_0025_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:02,821 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:39:02,821 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000002
2013-10-31 18:39:02,822 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000001_0 which needs 1 slots
2013-10-31 18:39:02,822 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000001_0 which needs 1 slots
2013-10-31 18:39:02,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken dst=null perm=null
2013-10-31 18:39:02,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50893, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3693249760350606050_1257, duration: 146653
2013-10-31 18:39:02,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=null
2013-10-31 18:39:02,830 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50895, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-407238121, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 165253
2013-10-31 18:39:02,837 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_-1157186059
2013-10-31 18:39:02,837 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_-1157186059 spawned.
2013-10-31 18:39:02,838 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000000_0/taskjvm.sh
2013-10-31 18:39:02,859 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:39:02,859 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000002_0 which needs 1 slots
2013-10-31 18:39:02,859 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000002_0 which needs 1 slots
2013-10-31 18:39:02,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken dst=null perm=null
2013-10-31 18:39:02,863 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47984, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 134568
2013-10-31 18:39:02,864 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,864 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,865 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:02,865 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-1073228223 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=null
2013-10-31 18:39:02,868 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50898, bytes: 28912, op: HDFS_READ, cliID: DFSClient_-736367666, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8650378453195215803_1254, duration: 163575
2013-10-31 18:39:02,880 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:02,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=null
2013-10-31 18:39:02,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44096, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-736367666, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5088351345251133232_1251, duration: 600083
2013-10-31 18:39:02,898 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0025_m_000003_0' to tip task_20131031182606197_0025_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:39:02,908 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:02,909 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:02,909 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:02,909 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0024_m_-1355604951 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:02,975 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_-1449916997
2013-10-31 18:39:02,976 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_-1449916997 spawned.
2013-10-31 18:39:02,978 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000002_0/taskjvm.sh
2013-10-31 18:39:02,992 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0025_m_000003
2013-10-31 18:39:02,994 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:39:02,994 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000003_0 which needs 1 slots
2013-10-31 18:39:02,994 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000003_0 which needs 1 slots
2013-10-31 18:39:02,996 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:02,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025/jobToken dst=null perm=null
2013-10-31 18:39:03,003 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47988, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3693249760350606050_1257, duration: 420215
2013-10-31 18:39:03,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.xml dst=null perm=null
2013-10-31 18:39:03,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47990, bytes: 28912, op: HDFS_READ, cliID: DFSClient_196448053, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8650378453195215803_1254, duration: 450414
2013-10-31 18:39:03,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=null
2013-10-31 18:39:03,030 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44100, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-407238121, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5088351345251133232_1251, duration: 1257489
2013-10-31 18:39:03,039 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:03,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.jar dst=null perm=null
2013-10-31 18:39:03,064 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50904, bytes: 239915, op: HDFS_READ, cliID: DFSClient_196448053, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5088351345251133232_1251, duration: 1594693
2013-10-31 18:39:03,114 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_1489451507
2013-10-31 18:39:03,115 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_1489451507 spawned.
2013-10-31 18:39:03,117 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000001_0/taskjvm.sh
2013-10-31 18:39:03,134 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_m_1569445512
2013-10-31 18:39:03,135 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_m_1569445512 spawned.
2013-10-31 18:39:03,136 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_m_000003_0/taskjvm.sh
2013-10-31 18:39:04,144 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1157186059 given task: attempt_20131031182606197_0025_m_000000_0
2013-10-31 18:39:04,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=null
2013-10-31 18:39:04,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:47995, bytes: 1571, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2159410241161564090_1252, duration: 167399
2013-10-31 18:39:04,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:04,705 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44105, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_298656553194616881_1249, duration: 147099
2013-10-31 18:39:05,020 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_1569445512 given task: attempt_20131031182606197_0025_m_000003_0
2013-10-31 18:39:05,032 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1449916997 given task: attempt_20131031182606197_0025_m_000002_0
2013-10-31 18:39:05,043 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_1489451507 given task: attempt_20131031182606197_0025_m_000001_0
2013-10-31 18:39:07,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=null
2013-10-31 18:39:07,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44110, bytes: 1055, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2159410241161564090_1252, duration: 163716
2013-10-31 18:39:07,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:07,506 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48004, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 124728
2013-10-31 18:39:07,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=null
2013-10-31 18:39:07,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025/job.split dst=null perm=null
2013-10-31 18:39:07,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50917, bytes: 1571, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2159410241161564090_1252, duration: 169655
2013-10-31 18:39:07,578 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48289, bytes: 539, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2159410241161564090_1252, duration: 159870
2013-10-31 18:39:07,592 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000000_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:30+11
2013-10-31 18:39:07,593 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000000_0 is done.
2013-10-31 18:39:07,593 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000000_0 was 6
2013-10-31 18:39:07,593 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:07,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:07,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:07,617 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48007, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 123075
2013-10-31 18:39:07,820 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:39:07,820 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0025_m_000005_0
2013-10-31 18:39:07,820 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0025_m_000005_0 not found in cache
2013-10-31 18:39:07,865 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48008, bytes: 45, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0025_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 134101
2013-10-31 18:39:08,826 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000000_0' has completed task_20131031182606197_0025_m_000000 successfully.
2013-10-31 18:39:08,827 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0025_r_000000_0' to tip task_20131031182606197_0025_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:08,829 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:08,830 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_r_000000_0 which needs 1 slots
2013-10-31 18:39:08,830 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_r_000000_0 which needs 1 slots
2013-10-31 18:39:08,866 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0025_r_723542760
2013-10-31 18:39:08,868 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0025_r_723542760 spawned.
2013-10-31 18:39:08,871 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0025/attempt_20131031182606197_0025_r_000000_0/taskjvm.sh
2013-10-31 18:39:09,740 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_r_723542760 given task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:10,396 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:10+10
2013-10-31 18:39:10,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000002_0 is done.
2013-10-31 18:39:10,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000002_0 was 28
2013-10-31 18:39:10,400 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:10,503 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:0+10
2013-10-31 18:39:10,505 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000001_0 is done.
2013-10-31 18:39:10,505 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000001_0 was 29
2013-10-31 18:39:10,505 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:10,506 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000:20+10
2013-10-31 18:39:10,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000003_0 is done.
2013-10-31 18:39:10,508 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000003_0 was 29
2013-10-31 18:39:10,509 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:11,833 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000001_0' has completed task_20131031182606197_0025_m_000001 successfully.
2013-10-31 18:39:11,869 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000002_0' has completed task_20131031182606197_0025_m_000002 successfully.
2013-10-31 18:39:12,001 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000003_0' has completed task_20131031182606197_0025_m_000003 successfully.
2013-10-31 18:39:15,459 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45002, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000000_0, duration: 9798398
2013-10-31 18:39:15,486 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42327, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000001_0, duration: 12329144
2013-10-31 18:39:15,503 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40307, bytes: 28, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000002_0, duration: 12109684
2013-10-31 18:39:15,522 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:49963, bytes: 29, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0025_m_000003_0, duration: 14208913
2013-10-31 18:39:16,254 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,297 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,358 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:16,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:16,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:16,586 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000. blk_466483600056883797_1258
2013-10-31 18:39:16,615 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:48299 dest: /127.0.0.1:54365
2013-10-31 18:39:16,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:50929 dest: /127.0.0.1:34578
2013-10-31 18:39:16,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_466483600056883797_1258 src: /127.0.0.1:48018 dest: /127.0.0.1:37740
2013-10-31 18:39:16,620 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48018, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_466483600056883797_1258, duration: 1871360
2013-10-31 18:39:16,620 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,621 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50929, dest: /127.0.0.1:34578, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_466483600056883797_1258, duration: 1953225
2013-10-31 18:39:16,621 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,621 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48299, dest: /127.0.0.1:54365, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0025_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_466483600056883797_1258, duration: 2633004
2013-10-31 18:39:16,621 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_466483600056883797_1258 terminating
2013-10-31 18:39:16,624 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,625 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,625 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:16,625 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:16,626 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_466483600056883797_1258 size 41
2013-10-31 18:39:16,661 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0025_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:39:16,661 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:17,839 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0025_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:42022
2013-10-31 18:39:17,840 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:18,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0 dst=null perm=null
2013-10-31 18:39:18,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:18,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:18,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary/_attempt_20131031182606197_0025_r_000000_0 dst=null perm=null
2013-10-31 18:39:19,305 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:19,307 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:19,308 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_r_000000_0 is done.
2013-10-31 18:39:19,308 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_r_000000_0 was -1
2013-10-31 18:39:19,308 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:20,842 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_r_000000_0' has completed task_20131031182606197_0025_r_000000 successfully.
2013-10-31 18:39:20,845 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0025_m_000004_0' to tip task_20131031182606197_0025_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:20,847 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0025_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:39:20,847 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0025_m_000004_0 which needs 1 slots
2013-10-31 18:39:20,847 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0025_m_000004_0 which needs 1 slots
2013-10-31 18:39:20,876 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0025/attempt_20131031182606197_0025_m_000004_0. Attempting to reuse: jvm_20131031182606197_0025_m_-1157186059
2013-10-31 18:39:21,644 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0025_m_-1157186059 given task: attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,771 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000004_0 0.0%
2013-10-31 18:39:21,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary dst=null perm=null
2013-10-31 18:39:21,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:21,791 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS from client DFSClient_attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,791 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0025_m_000004_0
2013-10-31 18:39:21,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,796 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5088351345251133232 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2159410241161564090 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4561088021142520977 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:21,797 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8650378453195215803 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:21,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0025 dst=null perm=null
2013-10-31 18:39:22,515 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_8650378453195215803_1254 blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:22,515 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_8650378453195215803_1254 blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:24,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data1/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:24,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data2/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:24,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data1/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:24,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data1/current/blk_-5088351345251133232
2013-10-31 18:39:24,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data2/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:24,294 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data1/current/blk_4561088021142520977
2013-10-31 18:39:24,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data2/current/blk_2159410241161564090
2013-10-31 18:39:24,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data2/current/blk_8650378453195215803
2013-10-31 18:39:24,366 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data7/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:24,366 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data8/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:24,366 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data7/current/blk_-5088351345251133232
2013-10-31 18:39:24,366 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data7/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:24,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data8/current/blk_2159410241161564090
2013-10-31 18:39:24,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data7/current/blk_4561088021142520977
2013-10-31 18:39:24,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data8/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:24,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data8/current/blk_8650378453195215803
2013-10-31 18:39:24,723 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0025_m_000004_0 0.0% cleanup
2013-10-31 18:39:24,725 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0025_m_000004_0 is done.
2013-10-31 18:39:24,725 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0025_m_000004_0 was -1
2013-10-31 18:39:24,726 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:25,516 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_4561088021142520977_1253 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:25,516 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_8650378453195215803_1254 blk_-5088351345251133232_1251 blk_2159410241161564090_1252
2013-10-31 18:39:25,847 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:25,848 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0025_r_000000_0
2013-10-31 18:39:26,168 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data3/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:26,168 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data4/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:26,169 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data3/current/blk_-5088351345251133232
2013-10-31 18:39:26,169 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data4/current/blk_2159410241161564090
2013-10-31 18:39:26,169 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4561088021142520977_1253 file build/test/data/dfs/data/data3/current/blk_4561088021142520977 for deletion
2013-10-31 18:39:26,170 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4561088021142520977_1253 at file build/test/data/dfs/data/data3/current/blk_4561088021142520977
2013-10-31 18:39:26,854 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0025_m_000004_0' has completed task_20131031182606197_0025_m_000004 successfully.
2013-10-31 18:39:26,855 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0025 has completed successfully.
2013-10-31 18:39:26,856 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0025,submitTime=1383244734438,launchTime=1383244734938,firstMapTaskLaunchTime=1383244742818,firstReduceTaskLaunchTime=1383244748827,firstJobSetupTaskLaunchTime=1383244736804,firstJobCleanupTaskLaunchTime=1383244760845,finishTime=1383244766855,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=35,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[1C92A88E814146F3BAF77C456D0E6369/529FD0E8AF384BB88C36593F7D1DB660] third/(3/3) ...latform/chainedtaps/third
2013-10-31 18:39:26,861 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8. blk_-7258127012634329331_1259
2013-10-31 18:39:26,864 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:48304 dest: /127.0.0.1:54365
2013-10-31 18:39:26,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:44131 dest: /127.0.0.1:59471
2013-10-31 18:39:26,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7258127012634329331_1259 src: /127.0.0.1:50935 dest: /127.0.0.1:34578
2013-10-31 18:39:26,874 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50935, dest: /127.0.0.1:34578, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7258127012634329331_1259, duration: 3011882
2013-10-31 18:39:26,875 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,875 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44131, dest: /127.0.0.1:59471, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7258127012634329331_1259, duration: 3903516
2013-10-31 18:39:26,876 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,876 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48304, dest: /127.0.0.1:54365, bytes: 27977, op: HDFS_WRITE, cliID: DFSClient_1105674743, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7258127012634329331_1259, duration: 4815169
2013-10-31 18:39:26,877 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7258127012634329331_1259 terminating
2013-10-31 18:39:26,879 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,879 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 from client DFSClient_1105674743
2013-10-31 18:39:26,880 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_logs/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 is closed by DFSClient_1105674743
2013-10-31 18:39:26,880 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,881 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7258127012634329331_1259 size 27977
2013-10-31 18:39:26,890 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0025_1383244734438_hadoop_%5B1C92A88E814146F3BAF77C456D0E6369%2F529FD0E8AF384BB8 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:39:26,891 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000000_0'
2013-10-31 18:39:26,891 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000004_0'
2013-10-31 18:39:26,891 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000005_0'
2013-10-31 18:39:26,891 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_r_000000_0'
2013-10-31 18:39:26,893 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:26,893 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000002_0'
2013-10-31 18:39:26,893 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:26,893 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3693249760350606050 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:26,894 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000001_0'
2013-10-31 18:39:26,896 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5088351345251133232_1251 file build/test/data/dfs/data/data6/current/blk_-5088351345251133232 for deletion
2013-10-31 18:39:26,897 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0025_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:39:26,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2159410241161564090_1252 file build/test/data/dfs/data/data5/current/blk_2159410241161564090 for deletion
2013-10-31 18:39:26,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5088351345251133232_1251 at file build/test/data/dfs/data/data6/current/blk_-5088351345251133232
2013-10-31 18:39:26,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8650378453195215803_1254 file build/test/data/dfs/data/data6/current/blk_8650378453195215803 for deletion
2013-10-31 18:39:26,897 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2159410241161564090_1252 at file build/test/data/dfs/data/data5/current/blk_2159410241161564090
2013-10-31 18:39:26,898 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8650378453195215803_1254 at file build/test/data/dfs/data/data6/current/blk_8650378453195215803
2013-10-31 18:39:26,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0025 dst=null perm=null
2013-10-31 18:39:26,900 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/_temporary
2013-10-31 18:39:26,902 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/_temporary
2013-10-31 18:39:26,904 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/_temporary
2013-10-31 18:39:26,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second dst=null perm=null
2013-10-31 18:39:26,924 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:39:26,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:26,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:26,929 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48025, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 290396
2013-10-31 18:39:26,929 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/first
2013-10-31 18:39:26,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first dst=null perm=null
2013-10-31 18:39:26,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/first/part-00000 dst=null perm=null
2013-10-31 18:39:26,935 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/third
2013-10-31 18:39:26,935 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48026, bytes: 144, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4840805767582090128_1240, duration: 264960
2013-10-31 18:39:26,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third dst=null perm=null
2013-10-31 18:39:26,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/third/part-00000 dst=null perm=null
2013-10-31 18:39:26,940 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/chainedtaps/second
2013-10-31 18:39:26,940 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48027, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_466483600056883797_1258, duration: 265496
2013-10-31 18:39:26,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second dst=null perm=null
2013-10-31 18:39:26,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/chainedtaps/second/part-00000 dst=null perm=null
2013-10-31 18:39:26,946 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48028, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_298656553194616881_1249, duration: 262402
2013-10-31 18:39:26,966 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:39:26,967 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:39:26,985 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:39:26,985 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:39:26,985 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall"]
2013-10-31 18:39:26,986 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:39:26,986 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 2
2013-10-31 18:39:26,986 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 2
2013-10-31 18:39:26,988 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/2)
2013-10-31 18:39:26,991 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:39:26,991 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:39:26,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:27,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:39:27,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,018 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0025_m_000003_0'
2013-10-31 18:39:27,018 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar. blk_5732320106450968581_1260
2013-10-31 18:39:27,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:50941 dest: /127.0.0.1:34578
2013-10-31 18:39:27,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:44139 dest: /127.0.0.1:59471
2013-10-31 18:39:27,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:48314 dest: /127.0.0.1:54365
2013-10-31 18:39:27,030 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48314, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5732320106450968581_1260, duration: 3833520
2013-10-31 18:39:27,031 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,031 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44139, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5732320106450968581_1260, duration: 5087788
2013-10-31 18:39:27,032 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,032 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50941, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5732320106450968581_1260, duration: 5674449
2013-10-31 18:39:27,033 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5732320106450968581_1260 terminating
2013-10-31 18:39:27,034 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,034 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar from client DFSClient_-1596270109
2013-10-31 18:39:27,035 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:39:27,035 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,036 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:27,040 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar. New replication is 10
2013-10-31 18:39:27,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=null
2013-10-31 18:39:27,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,051 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:39:27,055 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:39:27,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:39:27,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,422 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split. New replication is 10
2013-10-31 18:39:27,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=null
2013-10-31 18:39:27,429 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split. blk_6176005180406254197_1261
2013-10-31 18:39:27,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:50944 dest: /127.0.0.1:34578
2013-10-31 18:39:27,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:44142 dest: /127.0.0.1:59471
2013-10-31 18:39:27,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:48317 dest: /127.0.0.1:54365
2013-10-31 18:39:27,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6176005180406254197_1261 src: /127.0.0.1:48035 dest: /127.0.0.1:37740
2013-10-31 18:39:27,439 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48035, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6176005180406254197_1261, duration: 170832
2013-10-31 18:39:27,439 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,440 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48317, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6176005180406254197_1261, duration: 1000532
2013-10-31 18:39:27,440 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,440 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,441 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44142, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6176005180406254197_1261, duration: 1971317
2013-10-31 18:39:27,441 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,441 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,441 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50944, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 2872192
2013-10-31 18:39:27,442 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,442 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_6176005180406254197_1261 terminating
2013-10-31 18:39:27,445 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6176005180406254197_1261 size 1403
2013-10-31 18:39:27,445 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split from client DFSClient_-1596270109
2013-10-31 18:39:27,446 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split is closed by DFSClient_-1596270109
2013-10-31 18:39:27,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,465 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo. blk_9032010287967684730_1262
2013-10-31 18:39:27,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:48036 dest: /127.0.0.1:37740
2013-10-31 18:39:27,468 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:44146 dest: /127.0.0.1:59471
2013-10-31 18:39:27,470 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9032010287967684730_1262 src: /127.0.0.1:48321 dest: /127.0.0.1:54365
2013-10-31 18:39:27,473 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9032010287967684730_1262, duration: 66740
2013-10-31 18:39:27,473 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,474 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44146, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9032010287967684730_1262, duration: 868297
2013-10-31 18:39:27,474 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,475 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,475 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48036, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_9032010287967684730_1262, duration: 1678699
2013-10-31 18:39:27,475 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9032010287967684730_1262 terminating
2013-10-31 18:39:27,475 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,480 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_9032010287967684730_1262 size 156
2013-10-31 18:39:27,480 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:39:27,480 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:39:27,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,512 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml. blk_-4906023149535420440_1263
2013-10-31 18:39:27,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:48039 dest: /127.0.0.1:37740
2013-10-31 18:39:27,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:48323 dest: /127.0.0.1:54365
2013-10-31 18:39:27,517 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4906023149535420440_1263 src: /127.0.0.1:50953 dest: /127.0.0.1:34578
2013-10-31 18:39:27,520 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50953, dest: /127.0.0.1:34578, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 336563
2013-10-31 18:39:27,520 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,520 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,521 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48323, dest: /127.0.0.1:54365, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 1186542
2013-10-31 18:39:27,521 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,522 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48039, dest: /127.0.0.1:37740, bytes: 28417, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4906023149535420440_1263, duration: 2160995
2013-10-31 18:39:27,522 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4906023149535420440_1263 terminating
2013-10-31 18:39:27,524 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml from client DFSClient_-1596270109
2013-10-31 18:39:27,524 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:39:27,525 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,526 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4906023149535420440_1263 size 28417
2013-10-31 18:39:27,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=null
2013-10-31 18:39:27,539 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50955, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1039012288, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 486699
2013-10-31 18:39:27,558 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0026: nMaps=4 nReduces=1 max=-1
2013-10-31 18:39:27,558 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0026 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:39:27,558 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0026
2013-10-31 18:39:27,558 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0026 RESULT=SUCCESS
2013-10-31 18:39:27,559 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0026
2013-10-31 18:39:27,560 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0026
2013-10-31 18:39:27,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,591 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml. blk_-6217975784485380900_1265
2013-10-31 18:39:27,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:48044 dest: /127.0.0.1:37740
2013-10-31 18:39:27,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:48328 dest: /127.0.0.1:54365
2013-10-31 18:39:27,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6217975784485380900_1265 src: /127.0.0.1:44155 dest: /127.0.0.1:59471
2013-10-31 18:39:27,600 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44155, dest: /127.0.0.1:59471, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6217975784485380900_1265, duration: 363247
2013-10-31 18:39:27,601 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,601 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48328, dest: /127.0.0.1:54365, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6217975784485380900_1265, duration: 1775394
2013-10-31 18:39:27,601 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,602 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48044, dest: /127.0.0.1:37740, bytes: 28482, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6217975784485380900_1265, duration: 2061867
2013-10-31 18:39:27,603 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6217975784485380900_1265 terminating
2013-10-31 18:39:27,604 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,604 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml from client DFSClient_1039012288
2013-10-31 18:39:27,605 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_conf.xml is closed by DFSClient_1039012288
2013-10-31 18:39:27,605 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,606 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6217975784485380900_1265 size 28482
2013-10-31 18:39:27,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:27,618 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken. blk_-1528558439058240571_1266
2013-10-31 18:39:27,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:44156 dest: /127.0.0.1:59471
2013-10-31 18:39:27,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:50960 dest: /127.0.0.1:34578
2013-10-31 18:39:27,622 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1528558439058240571_1266 src: /127.0.0.1:48049 dest: /127.0.0.1:37740
2013-10-31 18:39:27,625 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48049, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1528558439058240571_1266, duration: 65888
2013-10-31 18:39:27,626 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,626 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,626 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:50960, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 940021
2013-10-31 18:39:27,627 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,627 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44156, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1528558439058240571_1266, duration: 1923655
2013-10-31 18:39:27,628 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1528558439058240571_1266 terminating
2013-10-31 18:39:27,633 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken from client DFSClient_-1596270109
2013-10-31 18:39:27,634 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:39:27,634 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1528558439058240571_1266 size 116
2013-10-31 18:39:27,641 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken
2013-10-31 18:39:27,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.splitmetainfo dst=null perm=null
2013-10-31 18:39:27,645 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44159, bytes: 160, op: HDFS_READ, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9032010287967684730_1262, duration: 277147
2013-10-31 18:39:27,646 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0026 = 1449. Number of splits = 4
2013-10-31 18:39:27,646 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,648 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0026_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:39:27,649 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0026 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:39:27,650 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0026 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:39:28,268 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_3135295757712174631_1031
2013-10-31 18:39:28,517 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_5732320106450968581_1260 to datanode(s) 127.0.0.1:37740
2013-10-31 18:39:28,517 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-3693249760350606050_1257
2013-10-31 18:39:28,517 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3693249760350606050_1257
2013-10-31 18:39:29,169 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data4/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:29,169 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data4/current/blk_-3693249760350606050
2013-10-31 18:39:29,897 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0026_m_000005_0' to tip task_20131031182606197_0026_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:29,901 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_5732320106450968581_1260 to 127.0.0.1:37740
2013-10-31 18:39:29,906 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:39:29,906 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000005_0 which needs 1 slots
2013-10-31 18:39:29,907 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000005_0 which needs 1 slots
2013-10-31 18:39:29,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5732320106450968581_1260 src: /127.0.0.1:48051 dest: /127.0.0.1:37740
2013-10-31 18:39:29,907 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_5732320106450968581_1260 to /127.0.0.1:37740
2013-10-31 18:39:29,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_5732320106450968581_1260 src: /127.0.0.1:48051 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:39:29,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken dst=null perm=null
2013-10-31 18:39:29,914 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5732320106450968581_1260 size 238055
2013-10-31 18:39:29,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50964, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 267473
2013-10-31 18:39:29,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=null
2013-10-31 18:39:29,925 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50966, bytes: 28641, op: HDFS_READ, cliID: DFSClient_323030406, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 375981
2013-10-31 18:39:29,955 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:29,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=null
2013-10-31 18:39:29,980 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48055, bytes: 239915, op: HDFS_READ, cliID: DFSClient_323030406, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5732320106450968581_1260, duration: 1187561
2013-10-31 18:39:30,073 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_1759873103
2013-10-31 18:39:30,074 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_1759873103 spawned.
2013-10-31 18:39:30,075 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000005_0/taskjvm.sh
2013-10-31 18:39:30,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data2/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:30,295 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data2/current/blk_-3693249760350606050
2013-10-31 18:39:31,439 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1759873103 given task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:31,518 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-3693249760350606050_1257
2013-10-31 18:39:31,893 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,893 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0025_m_000004_0 not found in cache
2013-10-31 18:39:31,894 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171894
2013-10-31 18:39:31,894 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171894
2013-10-31 18:39:31,895 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:31,895 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331171895
2013-10-31 18:39:31,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:31,962 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_-1449916997 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:31,970 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30996 with signal TERM. Exit code 0
2013-10-31 18:39:32,018 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0025
2013-10-31 18:39:32,019 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0025 for user-log deletion with retainTimeStamp:1383331172019
2013-10-31 18:39:32,065 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_1489451507 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,069 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30995 with signal TERM. Exit code 0
2013-10-31 18:39:32,069 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_1569445512 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,076 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30994 with signal TERM. Exit code 0
2013-10-31 18:39:32,146 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_892861919 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,151 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30741 with signal TERM. Exit code 0
2013-10-31 18:39:32,159 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,159 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,159 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:32,159 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_-1449916997 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,270 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,270 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,270 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:32,270 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_1489451507 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,271 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,271 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,271 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:32,271 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_1569445512 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,305 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,305 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,305 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:32,305 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_892861919 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:32,764 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_m_-1157186059 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:32,774 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group30954 with signal TERM. Exit code 0
2013-10-31 18:39:32,955 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:32,955 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:32,955 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:32,955 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_m_-1157186059 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:39:33,348 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0025_r_723542760 since job job_20131031182606197_0025 is dead
2013-10-31 18:39:33,358 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31184 with signal TERM. Exit code 0
2013-10-31 18:39:33,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3693249760350606050_1257 file build/test/data/dfs/data/data8/current/blk_-3693249760350606050 for deletion
2013-10-31 18:39:33,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3693249760350606050_1257 at file build/test/data/dfs/data/data8/current/blk_-3693249760350606050
2013-10-31 18:39:33,530 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:39:33,530 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:39:33,530 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:39:33,530 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0025_r_723542760 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:39:34,888 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000005_0 0.0% setup
2013-10-31 18:39:34,891 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000005_0 is done.
2013-10-31 18:39:34,891 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000005_0 was -1
2013-10-31 18:39:34,891 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:35,913 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000005_0' has completed task_20131031182606197_0026_m_000005 successfully.
2013-10-31 18:39:35,916 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000000_0' to tip task_20131031182606197_0026_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:35,917 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000000
2013-10-31 18:39:35,919 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:35,919 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000001_0' to tip task_20131031182606197_0026_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:39:35,919 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000000_0 which needs 1 slots
2013-10-31 18:39:35,920 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000000_0 which needs 1 slots
2013-10-31 18:39:35,920 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000001
2013-10-31 18:39:35,923 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:39:35,924 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000001_0 which needs 1 slots
2013-10-31 18:39:35,924 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000001_0 which needs 1 slots
2013-10-31 18:39:35,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken dst=null perm=null
2013-10-31 18:39:35,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48064, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1528558439058240571_1266, duration: 294516
2013-10-31 18:39:35,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=null
2013-10-31 18:39:35,942 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48349, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1958758557, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 392327
2013-10-31 18:39:35,949 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000002_0' to tip task_20131031182606197_0026_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:39:35,949 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000002
2013-10-31 18:39:35,951 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:39:35,951 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000002_0 which needs 1 slots
2013-10-31 18:39:35,951 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000002_0 which needs 1 slots
2013-10-31 18:39:35,953 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-367135844
2013-10-31 18:39:35,954 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-367135844 spawned.
2013-10-31 18:39:35,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken dst=null perm=null
2013-10-31 18:39:35,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50979, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 152617
2013-10-31 18:39:35,959 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000000_0/taskjvm.sh
2013-10-31 18:39:35,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=null
2013-10-31 18:39:35,966 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:35,968 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50981, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1820528008, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4906023149535420440_1263, duration: 407528
2013-10-31 18:39:35,980 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:35,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=null
2013-10-31 18:39:35,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50982, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1958758557, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5732320106450968581_1260, duration: 1397924
2013-10-31 18:39:35,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=null
2013-10-31 18:39:35,994 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48071, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1820528008, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5732320106450968581_1260, duration: 613521
2013-10-31 18:39:36,025 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0026_m_000003_0' to tip task_20131031182606197_0026_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:39:36,025 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0026_m_000003
2013-10-31 18:39:36,026 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:39:36,026 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000003_0 which needs 1 slots
2013-10-31 18:39:36,027 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000003_0 which needs 1 slots
2013-10-31 18:39:36,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026/jobToken dst=null perm=null
2013-10-31 18:39:36,033 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50984, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1528558439058240571_1266, duration: 152579
2013-10-31 18:39:36,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.xml dst=null perm=null
2013-10-31 18:39:36,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48357, bytes: 28641, op: HDFS_READ, cliID: DFSClient_1063817356, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4906023149535420440_1263, duration: 201686
2013-10-31 18:39:36,071 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-182868421
2013-10-31 18:39:36,071 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-182868421 spawned.
2013-10-31 18:39:36,073 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000002_0/taskjvm.sh
2013-10-31 18:39:36,091 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_-1931337023
2013-10-31 18:39:36,092 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_-1931337023 spawned.
2013-10-31 18:39:36,093 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000001_0/taskjvm.sh
2013-10-31 18:39:36,227 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:39:36,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.jar dst=null perm=null
2013-10-31 18:39:36,257 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48358, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1063817356, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5732320106450968581_1260, duration: 1181248
2013-10-31 18:39:37,032 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_m_1455195278
2013-10-31 18:39:37,033 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_m_1455195278 spawned.
2013-10-31 18:39:37,034 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_m_000003_0/taskjvm.sh
2013-10-31 18:39:37,955 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-182868421 given task: attempt_20131031182606197_0026_m_000002_0
2013-10-31 18:39:37,996 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-1931337023 given task: attempt_20131031182606197_0026_m_000001_0
2013-10-31 18:39:38,012 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_-367135844 given task: attempt_20131031182606197_0026_m_000000_0
2013-10-31 18:39:38,079 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1455195278 given task: attempt_20131031182606197_0026_m_000003_0
2013-10-31 18:39:38,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=null
2013-10-31 18:39:38,465 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50995, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 167534
2013-10-31 18:39:38,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=null
2013-10-31 18:39:38,500 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44193, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6176005180406254197_1261, duration: 160542
2013-10-31 18:39:38,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:39:38,504 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48085, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 147628
2013-10-31 18:39:38,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=null
2013-10-31 18:39:38,536 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:50999, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 159242
2013-10-31 18:39:38,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:39:38,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:39:38,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51000, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 155657
2013-10-31 18:39:38,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026/job.split dst=null perm=null
2013-10-31 18:39:38,616 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51001, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6176005180406254197_1261, duration: 150721
2013-10-31 18:39:38,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:39:38,655 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51002, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 168292
2013-10-31 18:39:38,794 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51003, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0026_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 167938
2013-10-31 18:39:40,920 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:40,920 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0026_m_000005_0
2013-10-31 18:39:40,920 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0026_m_000005_0 not found in cache
2013-10-31 18:39:41,010 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 95 raw values into 1 aggregated values, total 45
2013-10-31 18:39:41,393 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:39:41,396 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000002_0 is done.
2013-10-31 18:39:41,396 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000002_0 was 6
2013-10-31 18:39:41,396 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,429 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:39:41,431 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000001_0 is done.
2013-10-31 18:39:41,431 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000001_0 was 6
2013-10-31 18:39:41,431 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,461 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:39:41,462 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000000_0 is done.
2013-10-31 18:39:41,462 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000000_0 was 6
2013-10-31 18:39:41,462 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,541 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:39:41,544 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000003_0 is done.
2013-10-31 18:39:41,544 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000003_0 was 6
2013-10-31 18:39:41,544 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:41,924 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000000_0' has completed task_20131031182606197_0026_m_000000 successfully.
2013-10-31 18:39:42,549 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0026_r_000000_0' to tip task_20131031182606197_0026_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:42,550 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000003_0' has completed task_20131031182606197_0026_m_000003 successfully.
2013-10-31 18:39:42,552 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:39:42,552 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_r_000000_0 which needs 1 slots
2013-10-31 18:39:42,552 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_r_000000_0 which needs 1 slots
2013-10-31 18:39:42,553 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000002_0' has completed task_20131031182606197_0026_m_000002 successfully.
2013-10-31 18:39:42,556 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000001_0' has completed task_20131031182606197_0026_m_000001 successfully.
2013-10-31 18:39:42,600 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0026_r_519201635
2013-10-31 18:39:42,601 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0026_r_519201635 spawned.
2013-10-31 18:39:42,603 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0026/attempt_20131031182606197_0026_r_000000_0/taskjvm.sh
2013-10-31 18:39:43,428 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_r_519201635 given task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:49,125 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40388, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000000_0, duration: 6298378
2013-10-31 18:39:49,143 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50044, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000003_0, duration: 6565707
2013-10-31 18:39:49,159 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42411, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000002_0, duration: 13115422
2013-10-31 18:39:49,176 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45088, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0026_m_000001_0, duration: 12105968
2013-10-31 18:39:49,920 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:49,991 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:50,044 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:50,247 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1396 Total time for transactions(ms): 30Number of transactions batched in Syncs: 124 Number of syncs: 971 SyncTimes(ms): 66709 14626
2013-10-31 18:39:50,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:50,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:50,269 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000. blk_-1380093626912959803_1267
2013-10-31 18:39:50,291 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:48099 dest: /127.0.0.1:37740
2013-10-31 18:39:50,292 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:48383 dest: /127.0.0.1:54365
2013-10-31 18:39:50,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1380093626912959803_1267 src: /127.0.0.1:44210 dest: /127.0.0.1:59471
2013-10-31 18:39:50,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44210, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1380093626912959803_1267, duration: 1020773
2013-10-31 18:39:50,295 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48383, dest: /127.0.0.1:54365, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1380093626912959803_1267, duration: 1405525
2013-10-31 18:39:50,295 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48099, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0026_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1380093626912959803_1267, duration: 1792389
2013-10-31 18:39:50,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1380093626912959803_1267 terminating
2013-10-31 18:39:50,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:50,299 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:50,299 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:50,300 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:50,300 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1380093626912959803_1267 size 70
2013-10-31 18:39:51,561 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0026_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:39:51,627 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0026_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:39:51,627 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:39:52,967 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:54,566 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:39:54,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0 dst=null perm=null
2013-10-31 18:39:54,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:39:54,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:54,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary/_attempt_20131031182606197_0026_r_000000_0 dst=null perm=null
2013-10-31 18:39:55,999 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:39:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,007 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:56,009 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_r_000000_0 1.0% reduce > reduce
2013-10-31 18:39:56,009 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_r_000000_0 is done.
2013-10-31 18:39:56,009 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_r_000000_0 was -1
2013-10-31 18:39:56,010 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:39:56,011 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:39:56,032 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:39:57,570 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_r_000000_0' has completed task_20131031182606197_0026_r_000000 successfully.
2013-10-31 18:39:57,573 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0026_m_000004_0' to tip task_20131031182606197_0026_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:39:57,576 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0026_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:39:57,576 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0026_m_000004_0 which needs 1 slots
2013-10-31 18:39:57,576 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0026_m_000004_0 which needs 1 slots
2013-10-31 18:39:57,611 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0026/attempt_20131031182606197_0026_m_000004_0. Attempting to reuse: jvm_20131031182606197_0026_m_1759873103
2013-10-31 18:39:57,974 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0026_m_1759873103 given task: attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,091 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000004_0 0.0%
2013-10-31 18:39:58,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_temporary dst=null perm=null
2013-10-31 18:39:58,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:39:58,116 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS from client DFSClient_attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,116 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0026_m_000004_0
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5732320106450968581 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6176005180406254197 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,121 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:39:58,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_9032010287967684730 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:39:58,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:39:58,122 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4906023149535420440 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:39:58,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0026 dst=null perm=null
2013-10-31 18:39:58,522 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:39:58,523 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:39:59,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data4/current/blk_-4906023149535420440 for deletion
2013-10-31 18:39:59,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data3/current/blk_5732320106450968581 for deletion
2013-10-31 18:39:59,179 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data4/current/blk_-4906023149535420440
2013-10-31 18:39:59,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data4/current/blk_6176005180406254197 for deletion
2013-10-31 18:39:59,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data3/current/blk_5732320106450968581
2013-10-31 18:39:59,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data4/current/blk_6176005180406254197
2013-10-31 18:39:59,180 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data3/current/blk_9032010287967684730 for deletion
2013-10-31 18:39:59,181 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data3/current/blk_9032010287967684730
2013-10-31 18:40:00,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data1/current/blk_-4906023149535420440 for deletion
2013-10-31 18:40:00,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data1/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:00,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data1/current/blk_-4906023149535420440
2013-10-31 18:40:00,305 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data2/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:00,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data1/current/blk_5732320106450968581
2013-10-31 18:40:00,306 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data2/current/blk_6176005180406254197
2013-10-31 18:40:01,060 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0026_m_000004_0 0.0% cleanup
2013-10-31 18:40:01,061 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0026_m_000004_0 is done.
2013-10-31 18:40:01,062 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0026_m_000004_0 was -1
2013-10-31 18:40:01,062 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:01,523 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261 blk_-4906023149535420440_1263
2013-10-31 18:40:01,523 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_9032010287967684730_1262 blk_5732320106450968581_1260 blk_6176005180406254197_1261
2013-10-31 18:40:02,576 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:40:02,577 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0026_r_000000_0
2013-10-31 18:40:02,909 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data6/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:02,909 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data5/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:02,909 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data6/current/blk_5732320106450968581
2013-10-31 18:40:02,909 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data5/current/blk_6176005180406254197
2013-10-31 18:40:02,909 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data6/current/blk_9032010287967684730 for deletion
2013-10-31 18:40:02,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data6/current/blk_9032010287967684730
2013-10-31 18:40:03,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4906023149535420440_1263 file build/test/data/dfs/data/data8/current/blk_-4906023149535420440 for deletion
2013-10-31 18:40:03,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5732320106450968581_1260 file build/test/data/dfs/data/data7/current/blk_5732320106450968581 for deletion
2013-10-31 18:40:03,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4906023149535420440_1263 at file build/test/data/dfs/data/data8/current/blk_-4906023149535420440
2013-10-31 18:40:03,379 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6176005180406254197_1261 file build/test/data/dfs/data/data8/current/blk_6176005180406254197 for deletion
2013-10-31 18:40:03,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5732320106450968581_1260 at file build/test/data/dfs/data/data7/current/blk_5732320106450968581
2013-10-31 18:40:03,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_9032010287967684730_1262 file build/test/data/dfs/data/data7/current/blk_9032010287967684730 for deletion
2013-10-31 18:40:03,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6176005180406254197_1261 at file build/test/data/dfs/data/data8/current/blk_6176005180406254197
2013-10-31 18:40:03,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_9032010287967684730_1262 at file build/test/data/dfs/data/data7/current/blk_9032010287967684730
2013-10-31 18:40:03,584 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0026_m_000004_0' has completed task_20131031182606197_0026_m_000004 successfully.
2013-10-31 18:40:03,585 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0026 has completed successfully.
2013-10-31 18:40:03,585 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0026,submitTime=1383244767530,launchTime=1383244767649,firstMapTaskLaunchTime=1383244775915,firstReduceTaskLaunchTime=1383244782549,firstJobSetupTaskLaunchTime=1383244769897,firstJobCleanupTaskLaunchTime=1383244797573,finishTime=1383244803585,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=13,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FAAB6EBD019249188EA583AD21382B9F/D90437FD803C40DABA4DA224C6E69B82] test/(1/2)
2013-10-31 18:40:03,590 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA. blk_6068750247121428629_1268
2013-10-31 18:40:03,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:48388 dest: /127.0.0.1:54365
2013-10-31 18:40:03,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:51018 dest: /127.0.0.1:34578
2013-10-31 18:40:03,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6068750247121428629_1268 src: /127.0.0.1:44216 dest: /127.0.0.1:59471
2013-10-31 18:40:03,606 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44216, dest: /127.0.0.1:59471, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6068750247121428629_1268, duration: 6103471
2013-10-31 18:40:03,607 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,607 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51018, dest: /127.0.0.1:34578, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6068750247121428629_1268, duration: 3981101
2013-10-31 18:40:03,608 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,608 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,608 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48388, dest: /127.0.0.1:54365, bytes: 26184, op: HDFS_WRITE, cliID: DFSClient_1039012288, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6068750247121428629_1268, duration: 3213688
2013-10-31 18:40:03,609 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6068750247121428629_1268 terminating
2013-10-31 18:40:03,609 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,612 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA from client DFSClient_1039012288
2013-10-31 18:40:03,612 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/_logs/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA is closed by DFSClient_1039012288
2013-10-31 18:40:03,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6068750247121428629_1268 size 26184
2013-10-31 18:40:03,622 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0026_1383244767530_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FD90437FD803C40DA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:03,623 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000000_0'
2013-10-31 18:40:03,623 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000004_0'
2013-10-31 18:40:03,623 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000005_0'
2013-10-31 18:40:03,623 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_r_000000_0'
2013-10-31 18:40:03,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:03,625 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000001_0'
2013-10-31 18:40:03,625 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:03,626 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1528558439058240571 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:03,626 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000002_0'
2013-10-31 18:40:03,628 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0026_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:03,630 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (2/2) ...edpipesplatform/filterall
2013-10-31 18:40:03,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0026 dst=null perm=null
2013-10-31 18:40:03,636 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:40:03,636 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:40:03,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:03,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:40:03,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,668 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar. blk_6192954468864407371_1269
2013-10-31 18:40:03,670 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:51021 dest: /127.0.0.1:34578
2013-10-31 18:40:03,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:44219 dest: /127.0.0.1:59471
2013-10-31 18:40:03,677 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:48394 dest: /127.0.0.1:54365
2013-10-31 18:40:03,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48394, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6192954468864407371_1269, duration: 7524087
2013-10-31 18:40:03,688 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,688 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44219, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6192954468864407371_1269, duration: 8672118
2013-10-31 18:40:03,689 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,689 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51021, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6192954468864407371_1269, duration: 9250837
2013-10-31 18:40:03,690 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6192954468864407371_1269 terminating
2013-10-31 18:40:03,692 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,692 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar from client DFSClient_-1596270109
2013-10-31 18:40:03,692 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:40:03,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:03,698 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar. New replication is 10
2013-10-31 18:40:03,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar dst=null perm=null
2013-10-31 18:40:03,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,711 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:40:03,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6 dst=null perm=null
2013-10-31 18:40:03,717 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:03,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000 dst=null perm=null
2013-10-31 18:40:03,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,733 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split. New replication is 10
2013-10-31 18:40:03,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split dst=null perm=null
2013-10-31 18:40:03,740 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split. blk_-3080819444042136648_1270
2013-10-31 18:40:03,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:48395 dest: /127.0.0.1:54365
2013-10-31 18:40:03,744 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:44222 dest: /127.0.0.1:59471
2013-10-31 18:40:03,745 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:51026 dest: /127.0.0.1:34578
2013-10-31 18:40:03,747 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3080819444042136648_1270 src: /127.0.0.1:48115 dest: /127.0.0.1:37740
2013-10-31 18:40:03,750 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48115, dest: /127.0.0.1:37740, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3080819444042136648_1270, duration: 68117
2013-10-31 18:40:03,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,751 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51026, dest: /127.0.0.1:34578, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3080819444042136648_1270, duration: 905215
2013-10-31 18:40:03,752 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,752 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,752 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44222, dest: /127.0.0.1:59471, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3080819444042136648_1270, duration: 1844485
2013-10-31 18:40:03,753 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,753 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,753 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48395, dest: /127.0.0.1:54365, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3080819444042136648_1270, duration: 2840182
2013-10-31 18:40:03,754 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,754 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3080819444042136648_1270 terminating
2013-10-31 18:40:03,758 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3080819444042136648_1270 size 351
2013-10-31 18:40:03,759 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split from client DFSClient_-1596270109
2013-10-31 18:40:03,759 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split is closed by DFSClient_-1596270109
2013-10-31 18:40:03,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:03,782 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo. blk_2526140641696613949_1271
2013-10-31 18:40:03,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:48399 dest: /127.0.0.1:54365
2013-10-31 18:40:03,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:44226 dest: /127.0.0.1:59471
2013-10-31 18:40:03,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2526140641696613949_1271 src: /127.0.0.1:48118 dest: /127.0.0.1:37740
2013-10-31 18:40:03,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48118, dest: /127.0.0.1:37740, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2526140641696613949_1271, duration: 64946
2013-10-31 18:40:03,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44226, dest: /127.0.0.1:59471, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2526140641696613949_1271, duration: 878256
2013-10-31 18:40:03,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:03,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48399, dest: /127.0.0.1:54365, bytes: 43, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2526140641696613949_1271, duration: 1956745
2013-10-31 18:40:03,792 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2526140641696613949_1271 terminating
2013-10-31 18:40:03,792 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:03,794 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:40:03,794 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:40:03,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2526140641696613949_1271 size 43
2013-10-31 18:40:04,524 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_6192954468864407371_1269 to datanode(s) 127.0.0.1:37740
2013-10-31 18:40:04,525 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-1528558439058240571_1266
2013-10-31 18:40:04,525 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-1528558439058240571_1266
2013-10-31 18:40:04,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,739 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml. blk_6254397619874930752_1272
2013-10-31 18:40:04,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:51031 dest: /127.0.0.1:34578
2013-10-31 18:40:04,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:48120 dest: /127.0.0.1:37740
2013-10-31 18:40:04,745 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6254397619874930752_1272 src: /127.0.0.1:48404 dest: /127.0.0.1:54365
2013-10-31 18:40:04,748 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48404, dest: /127.0.0.1:54365, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6254397619874930752_1272, duration: 280141
2013-10-31 18:40:04,749 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,749 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48120, dest: /127.0.0.1:37740, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6254397619874930752_1272, duration: 1148620
2013-10-31 18:40:04,750 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,750 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51031, dest: /127.0.0.1:34578, bytes: 28632, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6254397619874930752_1272, duration: 2203859
2013-10-31 18:40:04,751 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6254397619874930752_1272 terminating
2013-10-31 18:40:04,752 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,753 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml from client DFSClient_-1596270109
2013-10-31 18:40:04,754 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:40:04,754 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,755 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6254397619874930752_1272 size 28632
2013-10-31 18:40:04,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml dst=null perm=null
2013-10-31 18:40:04,770 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48406, bytes: 28856, op: HDFS_READ, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6254397619874930752_1272, duration: 404077
2013-10-31 18:40:04,788 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0027: nMaps=1 nReduces=1 max=-1
2013-10-31 18:40:04,788 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0027 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:40:04,788 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0027 RESULT=SUCCESS
2013-10-31 18:40:04,788 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0027
2013-10-31 18:40:04,789 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0027
2013-10-31 18:40:04,789 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0027
2013-10-31 18:40:04,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,818 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml. blk_305302745974780331_1274
2013-10-31 18:40:04,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:51036 dest: /127.0.0.1:34578
2013-10-31 18:40:04,821 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:44234 dest: /127.0.0.1:59471
2013-10-31 18:40:04,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_305302745974780331_1274 src: /127.0.0.1:48126 dest: /127.0.0.1:37740
2013-10-31 18:40:04,827 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48126, dest: /127.0.0.1:37740, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_305302745974780331_1274, duration: 339927
2013-10-31 18:40:04,827 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,827 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44234, dest: /127.0.0.1:59471, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_305302745974780331_1274, duration: 1334418
2013-10-31 18:40:04,828 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,828 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51036, dest: /127.0.0.1:34578, bytes: 28697, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_305302745974780331_1274, duration: 2180716
2013-10-31 18:40:04,829 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_305302745974780331_1274 terminating
2013-10-31 18:40:04,831 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,831 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml from client DFSClient_-856516835
2013-10-31 18:40:04,831 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_conf.xml is closed by DFSClient_-856516835
2013-10-31 18:40:04,832 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,833 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_305302745974780331_1274 size 28697
2013-10-31 18:40:04,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:04,847 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken. blk_-4765952773309717476_1275
2013-10-31 18:40:04,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:48410 dest: /127.0.0.1:54365
2013-10-31 18:40:04,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:44237 dest: /127.0.0.1:59471
2013-10-31 18:40:04,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4765952773309717476_1275 src: /127.0.0.1:51041 dest: /127.0.0.1:34578
2013-10-31 18:40:04,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51041, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4765952773309717476_1275, duration: 67059
2013-10-31 18:40:04,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,855 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44237, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4765952773309717476_1275, duration: 950958
2013-10-31 18:40:04,856 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,856 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48410, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4765952773309717476_1275, duration: 1795885
2013-10-31 18:40:04,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4765952773309717476_1275 terminating
2013-10-31 18:40:04,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,862 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken from client DFSClient_-1596270109
2013-10-31 18:40:04,862 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:40:04,863 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4765952773309717476_1275 size 116
2013-10-31 18:40:04,868 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken
2013-10-31 18:40:04,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.splitmetainfo dst=null perm=null
2013-10-31 18:40:04,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48413, bytes: 47, op: HDFS_READ, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2526140641696613949_1271, duration: 275308
2013-10-31 18:40:04,872 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0027 = 70. Number of splits = 1
2013-10-31 18:40:04,872 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0027_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:04,873 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0027 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:40:04,874 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0027 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:40:05,910 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_6192954468864407371_1269 to 127.0.0.1:37740
2013-10-31 18:40:05,910 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data6/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:05,911 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data6/current/blk_-1528558439058240571
2013-10-31 18:40:05,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6192954468864407371_1269 src: /127.0.0.1:48131 dest: /127.0.0.1:37740
2013-10-31 18:40:05,912 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_6192954468864407371_1269 to /127.0.0.1:37740
2013-10-31 18:40:05,915 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6192954468864407371_1269 src: /127.0.0.1:48131 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:40:05,916 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6192954468864407371_1269 size 238055
2013-10-31 18:40:06,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data2/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:06,307 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data2/current/blk_-1528558439058240571
2013-10-31 18:40:06,585 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0027_m_000002_0' to tip task_20131031182606197_0027_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:06,588 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0026_m_000003_0'
2013-10-31 18:40:06,589 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:40:06,589 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000002_0 which needs 1 slots
2013-10-31 18:40:06,589 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000002_0 which needs 1 slots
2013-10-31 18:40:06,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027/jobToken dst=null perm=null
2013-10-31 18:40:06,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44241, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4765952773309717476_1275, duration: 309037
2013-10-31 18:40:06,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.xml dst=null perm=null
2013-10-31 18:40:06,601 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48134, bytes: 28856, op: HDFS_READ, cliID: DFSClient_-221887911, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6254397619874930752_1272, duration: 380009
2013-10-31 18:40:06,619 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:06,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.jar dst=null perm=null
2013-10-31 18:40:06,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51047, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-221887911, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6192954468864407371_1269, duration: 834652
2013-10-31 18:40:06,728 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_m_1741630968
2013-10-31 18:40:06,728 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_m_1741630968 spawned.
2013-10-31 18:40:06,730 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_m_000002_0/taskjvm.sh
2013-10-31 18:40:07,526 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-1528558439058240571_1266
2013-10-31 18:40:08,625 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,626 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0026_m_000004_0 not found in cache
2013-10-31 18:40:08,627 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208626
2013-10-31 18:40:08,663 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,663 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:08,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208664
2013-10-31 18:40:08,664 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331208664
2013-10-31 18:40:08,983 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-182868421 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:08,994 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31615 with signal TERM. Exit code 0
2013-10-31 18:40:09,004 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-1931337023 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,016 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31616 with signal TERM. Exit code 0
2013-10-31 18:40:09,034 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_-367135844 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,044 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31614 with signal TERM. Exit code 0
2013-10-31 18:40:09,091 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_1759873103 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:09,096 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31399 with signal TERM. Exit code 0
2013-10-31 18:40:09,234 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,234 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,234 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:09,234 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-182868421 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,234 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,234 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,234 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:09,235 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-1931337023 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,240 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,240 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,240 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:09,241 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_-367135844 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:09,252 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:09,252 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:09,252 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:09,252 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_1759873103 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:40:09,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1528558439058240571_1266 file build/test/data/dfs/data/data8/current/blk_-1528558439058240571 for deletion
2013-10-31 18:40:09,380 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1528558439058240571_1266 at file build/test/data/dfs/data/data8/current/blk_-1528558439058240571
2013-10-31 18:40:10,005 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1741630968 given task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:10,056 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_r_519201635 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:10,060 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31854 with signal TERM. Exit code 0
2013-10-31 18:40:10,220 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:10,220 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:10,220 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:10,221 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_r_519201635 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:10,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:11,589 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0026
2013-10-31 18:40:11,590 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0026 for user-log deletion with retainTimeStamp:1383331211590
2013-10-31 18:40:12,134 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0026_m_1455195278 since job job_20131031182606197_0026 is dead
2013-10-31 18:40:12,144 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group31719 with signal TERM. Exit code 0
2013-10-31 18:40:12,392 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:12,392 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:12,393 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:12,393 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0026_m_1455195278 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:13,455 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000002_0 0.0% setup
2013-10-31 18:40:13,458 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000002_0 is done.
2013-10-31 18:40:13,459 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000002_0 was -1
2013-10-31 18:40:13,459 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:15,596 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000002_0' has completed task_20131031182606197_0027_m_000002 successfully.
2013-10-31 18:40:15,599 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0027_m_000000_0' to tip task_20131031182606197_0027_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:15,601 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0027_m_000000
2013-10-31 18:40:15,602 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:15,603 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000000_0 which needs 1 slots
2013-10-31 18:40:15,603 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000000_0 which needs 1 slots
2013-10-31 18:40:15,635 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_m_1809268964
2013-10-31 18:40:15,635 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_m_1809268964 spawned.
2013-10-31 18:40:15,637 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_m_000000_0/taskjvm.sh
2013-10-31 18:40:16,500 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1809268964 given task: attempt_20131031182606197_0027_m_000000_0
2013-10-31 18:40:17,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027/job.split dst=null perm=null
2013-10-31 18:40:17,017 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48424, bytes: 355, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0027_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3080819444042136648_1270, duration: 128239
2013-10-31 18:40:17,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000 dst=null perm=null
2013-10-31 18:40:17,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48142, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0027_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1380093626912959803_1267, duration: 284926
2013-10-31 18:40:19,948 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000000_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6/part-00000:0+70
2013-10-31 18:40:19,950 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000000_0 is done.
2013-10-31 18:40:19,951 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000000_0 was 6
2013-10-31 18:40:19,951 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:20,603 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:20,603 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0027_m_000002_0
2013-10-31 18:40:20,604 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0027_m_000002_0 not found in cache
2013-10-31 18:40:21,609 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000000_0' has completed task_20131031182606197_0027_m_000000 successfully.
2013-10-31 18:40:21,739 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0027_r_000000_0' to tip task_20131031182606197_0027_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:21,742 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:21,743 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_r_000000_0 which needs 1 slots
2013-10-31 18:40:21,743 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_r_000000_0 which needs 1 slots
2013-10-31 18:40:21,775 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0027_r_95840884
2013-10-31 18:40:21,776 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0027_r_95840884 spawned.
2013-10-31 18:40:21,778 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0027/attempt_20131031182606197_0027_r_000000_0/taskjvm.sh
2013-10-31 18:40:22,593 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_r_95840884 given task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:28,283 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50093, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0027_m_000000_0, duration: 6880766
2013-10-31 18:40:29,110 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,156 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,206 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:29,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:29,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:29,427 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:29,427 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:29,467 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0027_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:29,468 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:40:30,752 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0027_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:33516
2013-10-31 18:40:30,753 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:31,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0 dst=null perm=null
2013-10-31 18:40:31,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:31,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:31,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary/_attempt_20131031182606197_0027_r_000000_0 dst=null perm=null
2013-10-31 18:40:32,151 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 1.0% reduce > reduce
2013-10-31 18:40:32,153 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_r_000000_0 1.0% reduce > reduce
2013-10-31 18:40:32,154 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_r_000000_0 is done.
2013-10-31 18:40:32,154 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_r_000000_0 was -1
2013-10-31 18:40:32,154 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:33,757 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_r_000000_0' has completed task_20131031182606197_0027_r_000000 successfully.
2013-10-31 18:40:33,761 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0027_m_000001_0' to tip task_20131031182606197_0027_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:33,763 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0027_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:40:33,763 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0027_m_000001_0 which needs 1 slots
2013-10-31 18:40:33,763 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0027_m_000001_0 which needs 1 slots
2013-10-31 18:40:33,796 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0027/attempt_20131031182606197_0027_m_000001_0. Attempting to reuse: jvm_20131031182606197_0027_m_1809268964
2013-10-31 18:40:34,020 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0027_m_1809268964 given task: attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,157 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000001_0 0.0%
2013-10-31 18:40:34,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary dst=null perm=null
2013-10-31 18:40:34,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:34,244 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS from client DFSClient_attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,244 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0027_m_000001_0
2013-10-31 18:40:34,248 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6192954468864407371 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3080819444042136648 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2526140641696613949 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:34,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:34,250 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6254397619874930752 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:34,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0027 dst=null perm=null
2013-10-31 18:40:34,530 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:34,531 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_6254397619874930752_1272 blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data6/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data5/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data6/current/blk_-3080819444042136648
2013-10-31 18:40:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data5/current/blk_2526140641696613949
2013-10-31 18:40:35,920 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data5/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:35,921 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data5/current/blk_6192954468864407371
2013-10-31 18:40:36,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data7/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:36,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data8/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:36,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data7/current/blk_-3080819444042136648
2013-10-31 18:40:36,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data7/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:36,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data8/current/blk_2526140641696613949
2013-10-31 18:40:36,391 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data7/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:36,391 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data7/current/blk_6192954468864407371
2013-10-31 18:40:36,391 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data7/current/blk_6254397619874930752
2013-10-31 18:40:37,103 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0027_m_000001_0 0.0% cleanup
2013-10-31 18:40:37,104 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0027_m_000001_0 is done.
2013-10-31 18:40:37,105 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0027_m_000001_0 was -1
2013-10-31 18:40:37,105 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:37,531 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_6254397619874930752_1272 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:37,531 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_6254397619874930752_1272 blk_2526140641696613949_1271 blk_6192954468864407371_1269 blk_-3080819444042136648_1270
2013-10-31 18:40:38,192 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data3/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:38,192 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2526140641696613949_1271 file build/test/data/dfs/data/data4/current/blk_2526140641696613949 for deletion
2013-10-31 18:40:38,192 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data3/current/blk_-3080819444042136648
2013-10-31 18:40:38,192 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data4/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:38,192 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2526140641696613949_1271 at file build/test/data/dfs/data/data4/current/blk_2526140641696613949
2013-10-31 18:40:38,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data3/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:38,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data4/current/blk_6192954468864407371
2013-10-31 18:40:38,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data3/current/blk_6254397619874930752
2013-10-31 18:40:38,763 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:38,763 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0027_r_000000_0
2013-10-31 18:40:39,317 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3080819444042136648_1270 file build/test/data/dfs/data/data1/current/blk_-3080819444042136648 for deletion
2013-10-31 18:40:39,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6192954468864407371_1269 file build/test/data/dfs/data/data2/current/blk_6192954468864407371 for deletion
2013-10-31 18:40:39,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3080819444042136648_1270 at file build/test/data/dfs/data/data1/current/blk_-3080819444042136648
2013-10-31 18:40:39,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6254397619874930752_1272 file build/test/data/dfs/data/data2/current/blk_6254397619874930752 for deletion
2013-10-31 18:40:39,318 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6192954468864407371_1269 at file build/test/data/dfs/data/data2/current/blk_6192954468864407371
2013-10-31 18:40:39,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6254397619874930752_1272 at file build/test/data/dfs/data/data2/current/blk_6254397619874930752
2013-10-31 18:40:39,771 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0027_m_000001_0' has completed task_20131031182606197_0027_m_000001 successfully.
2013-10-31 18:40:39,772 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0027 has completed successfully.
2013-10-31 18:40:39,772 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0027,submitTime=1383244804761,launchTime=1383244804873,firstMapTaskLaunchTime=1383244815599,firstReduceTaskLaunchTime=1383244821739,firstJobSetupTaskLaunchTime=1383244806585,firstJobCleanupTaskLaunchTime=1383244833760,finishTime=1383244839772,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=14,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FAAB6EBD019249188EA583AD21382B9F/B48CA6662923465080E2D1C399F5391B] test/(2/2) ...edpipesplatform/filterall
2013-10-31 18:40:39,776 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650. blk_-5286525445320680021_1277
2013-10-31 18:40:39,778 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:48151 dest: /127.0.0.1:37740
2013-10-31 18:40:39,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:51064 dest: /127.0.0.1:34578
2013-10-31 18:40:39,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5286525445320680021_1277 src: /127.0.0.1:48436 dest: /127.0.0.1:54365
2013-10-31 18:40:39,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48436, dest: /127.0.0.1:54365, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5286525445320680021_1277, duration: 6936511
2013-10-31 18:40:39,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,794 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51064, dest: /127.0.0.1:34578, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5286525445320680021_1277, duration: 5902215
2013-10-31 18:40:39,794 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48151, dest: /127.0.0.1:37740, bytes: 14575, op: HDFS_WRITE, cliID: DFSClient_-856516835, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5286525445320680021_1277, duration: 5203491
2013-10-31 18:40:39,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5286525445320680021_1277 terminating
2013-10-31 18:40:39,798 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,799 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 from client DFSClient_-856516835
2013-10-31 18:40:39,799 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_logs/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 is closed by DFSClient_-856516835
2013-10-31 18:40:39,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5286525445320680021_1277 size 14575
2013-10-31 18:40:39,806 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0027_1383244804761_hadoop_%5BFAAB6EBD019249188EA583AD21382B9F%2FB48CA66629234650 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:39,806 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000000_0'
2013-10-31 18:40:39,807 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000001_0'
2013-10-31 18:40:39,807 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_m_000002_0'
2013-10-31 18:40:39,807 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0027_r_000000_0'
2013-10-31 18:40:39,808 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:39,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,809 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4765952773309717476 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,811 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0027_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:40:39,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0027 dst=null perm=null
2013-10-31 18:40:39,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,815 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6068750247121428629 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6217975784485380900 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:39,816 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:39,817 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1380093626912959803 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:39,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/7865834974_test_82B6D363704041A3A68B811089A5ABB6 dst=null perm=null
2013-10-31 18:40:39,823 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/_temporary
2013-10-31 18:40:39,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall dst=null perm=null
2013-10-31 18:40:39,843 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:39,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000 dst=null perm=null
2013-10-31 18:40:39,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000 dst=null perm=null
2013-10-31 18:40:39,846 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filterall
2013-10-31 18:40:39,847 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:39,847 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:39,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall dst=null perm=null
2013-10-31 18:40:39,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filterall/part-00000 dst=null perm=null
2013-10-31 18:40:39,870 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:40:39,870 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:40:39,885 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting
2013-10-31 18:40:39,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:40:39,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename"]
2013-10-31 18:40:39,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] parallel execution is enabled: true
2013-10-31 18:40:39,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] starting jobs: 2
2013-10-31 18:40:39,886 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [merged] allocating threads: 2
2013-10-31 18:40:39,887 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (1/2)
2013-10-31 18:40:39,890 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:40:39,890 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:40:39,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:39,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:40:39,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,905 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar. blk_-4010317939662345352_1278
2013-10-31 18:40:39,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:44264 dest: /127.0.0.1:59471
2013-10-31 18:40:39,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:51068 dest: /127.0.0.1:34578
2013-10-31 18:40:39,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:48440 dest: /127.0.0.1:54365
2013-10-31 18:40:39,916 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48440, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4010317939662345352_1278, duration: 6607982
2013-10-31 18:40:39,917 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,917 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51068, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 6731047
2013-10-31 18:40:39,917 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,918 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44264, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4010317939662345352_1278, duration: 8097512
2013-10-31 18:40:39,918 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,919 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4010317939662345352_1278 terminating
2013-10-31 18:40:39,920 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,920 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:39,921 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar from client DFSClient_-1596270109
2013-10-31 18:40:39,921 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:40:39,926 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar. New replication is 10
2013-10-31 18:40:39,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=null
2013-10-31 18:40:39,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,941 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:40:39,947 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:40:39,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:40:39,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:39,966 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split. New replication is 10
2013-10-31 18:40:39,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=null
2013-10-31 18:40:39,975 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split. blk_-235108636050631590_1279
2013-10-31 18:40:39,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:51070 dest: /127.0.0.1:34578
2013-10-31 18:40:39,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:48159 dest: /127.0.0.1:37740
2013-10-31 18:40:39,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:44269 dest: /127.0.0.1:59471
2013-10-31 18:40:39,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-235108636050631590_1279 src: /127.0.0.1:48444 dest: /127.0.0.1:54365
2013-10-31 18:40:39,982 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48444, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 1140844
2013-10-31 18:40:39,982 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44269, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-235108636050631590_1279, duration: 618434
2013-10-31 18:40:39,983 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48159, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 1685836
2013-10-31 18:40:39,983 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51070, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-235108636050631590_1279, duration: 1433285
2013-10-31 18:40:39,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-235108636050631590_1279 terminating
2013-10-31 18:40:39,987 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,987 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split from client DFSClient_-1596270109
2013-10-31 18:40:39,987 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split is closed by DFSClient_-1596270109
2013-10-31 18:40:39,987 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,987 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,988 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-235108636050631590_1279 size 1403
2013-10-31 18:40:39,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,007 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo. blk_-2267545822353736092_1280
2013-10-31 18:40:40,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:48162 dest: /127.0.0.1:37740
2013-10-31 18:40:40,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:51075 dest: /127.0.0.1:34578
2013-10-31 18:40:40,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2267545822353736092_1280 src: /127.0.0.1:48447 dest: /127.0.0.1:54365
2013-10-31 18:40:40,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48447, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2267545822353736092_1280, duration: 849243
2013-10-31 18:40:40,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51075, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2267545822353736092_1280, duration: 673079
2013-10-31 18:40:40,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48162, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2267545822353736092_1280, duration: 1496977
2013-10-31 18:40:40,015 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2267545822353736092_1280 terminating
2013-10-31 18:40:40,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,017 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,017 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:40:40,017 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:40:40,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2267545822353736092_1280 size 156
2013-10-31 18:40:40,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,042 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml. blk_5626442093913306657_1281
2013-10-31 18:40:40,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:48165 dest: /127.0.0.1:37740
2013-10-31 18:40:40,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:48449 dest: /127.0.0.1:54365
2013-10-31 18:40:40,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5626442093913306657_1281 src: /127.0.0.1:44276 dest: /127.0.0.1:59471
2013-10-31 18:40:40,047 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44276, dest: /127.0.0.1:59471, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5626442093913306657_1281, duration: 1174480
2013-10-31 18:40:40,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48449, dest: /127.0.0.1:54365, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 785379
2013-10-31 18:40:40,048 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,048 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48165, dest: /127.0.0.1:37740, bytes: 27454, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5626442093913306657_1281, duration: 1208724
2013-10-31 18:40:40,049 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5626442093913306657_1281 terminating
2013-10-31 18:40:40,051 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,052 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,052 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml from client DFSClient_-1596270109
2013-10-31 18:40:40,052 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:40:40,053 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5626442093913306657_1281 size 27454
2013-10-31 18:40:40,532 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4010317939662345352_1278 to datanode(s) 127.0.0.1:37740
2013-10-31 18:40:40,533 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_6068750247121428629_1268 blk_-4765952773309717476_1275 blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:40,533 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_6068750247121428629_1268 blk_-4765952773309717476_1275 blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:40,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=null
2013-10-31 18:40:40,741 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48169, bytes: 27670, op: HDFS_READ, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5626442093913306657_1281, duration: 429357
2013-10-31 18:40:40,748 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0028: nMaps=4 nReduces=0 max=-1
2013-10-31 18:40:40,749 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0028 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:40:40,749 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0028 RESULT=SUCCESS
2013-10-31 18:40:40,749 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0028
2013-10-31 18:40:40,749 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0028
2013-10-31 18:40:40,750 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0028
2013-10-31 18:40:40,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,779 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml. blk_-566339595978537805_1283
2013-10-31 18:40:40,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:48453 dest: /127.0.0.1:54365
2013-10-31 18:40:40,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:48171 dest: /127.0.0.1:37740
2013-10-31 18:40:40,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-566339595978537805_1283 src: /127.0.0.1:51084 dest: /127.0.0.1:34578
2013-10-31 18:40:40,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51084, dest: /127.0.0.1:34578, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-566339595978537805_1283, duration: 519613
2013-10-31 18:40:40,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48171, dest: /127.0.0.1:37740, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-566339595978537805_1283, duration: 1392949
2013-10-31 18:40:40,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,790 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48453, dest: /127.0.0.1:54365, bytes: 27519, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-566339595978537805_1283, duration: 2270880
2013-10-31 18:40:40,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-566339595978537805_1283 terminating
2013-10-31 18:40:40,791 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,793 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml from client DFSClient_489287705
2013-10-31 18:40:40,793 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_conf.xml is closed by DFSClient_489287705
2013-10-31 18:40:40,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-566339595978537805_1283 size 27519
2013-10-31 18:40:40,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:40,804 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken. blk_295024924997773881_1284
2013-10-31 18:40:40,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:48173 dest: /127.0.0.1:37740
2013-10-31 18:40:40,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:44283 dest: /127.0.0.1:59471
2013-10-31 18:40:40,809 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_295024924997773881_1284 src: /127.0.0.1:51087 dest: /127.0.0.1:34578
2013-10-31 18:40:40,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51087, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 68859
2013-10-31 18:40:40,812 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,812 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44283, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_295024924997773881_1284, duration: 846879
2013-10-31 18:40:40,813 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,813 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,813 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48173, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_295024924997773881_1284, duration: 1735488
2013-10-31 18:40:40,814 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_295024924997773881_1284 terminating
2013-10-31 18:40:40,815 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,816 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_295024924997773881_1284 size 116
2013-10-31 18:40:40,816 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken from client DFSClient_-1596270109
2013-10-31 18:40:40,817 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:40:40,822 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken
2013-10-31 18:40:40,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.splitmetainfo dst=null perm=null
2013-10-31 18:40:40,826 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48459, bytes: 160, op: HDFS_READ, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2267545822353736092_1280, duration: 280292
2013-10-31 18:40:40,827 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0028 = 1449. Number of splits = 4
2013-10-31 18:40:40,827 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,828 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,829 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0028_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:40:40,830 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0028 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:40:40,831 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0028 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:40:41,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data3/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:41,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data4/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:41,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data3/current/blk_-6217975784485380900
2013-10-31 18:40:41,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data4/current/blk_-4765952773309717476
2013-10-31 18:40:41,193 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data4/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:41,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data3/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:41,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data4/current/blk_-1380093626912959803
2013-10-31 18:40:41,194 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data3/current/blk_6068750247121428629
2013-10-31 18:40:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data5/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data5/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data5/current/blk_-6217975784485380900
2013-10-31 18:40:41,922 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data5/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:41,923 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data5/current/blk_-4765952773309717476
2013-10-31 18:40:41,923 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data6/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:41,923 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data5/current/blk_-1380093626912959803
2013-10-31 18:40:41,923 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data6/current/blk_6068750247121428629
2013-10-31 18:40:42,319 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4010317939662345352_1278 to 127.0.0.1:37740
2013-10-31 18:40:42,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4010317939662345352_1278 src: /127.0.0.1:48177 dest: /127.0.0.1:37740
2013-10-31 18:40:42,321 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4010317939662345352_1278 to /127.0.0.1:37740
2013-10-31 18:40:42,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4010317939662345352_1278 src: /127.0.0.1:48177 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:40:42,326 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4010317939662345352_1278 size 238055
2013-10-31 18:40:42,765 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0028_m_000005_0' to tip task_20131031182606197_0028_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:40:42,772 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:40:42,772 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000005_0 which needs 1 slots
2013-10-31 18:40:42,772 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:42,773 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000005_0 which needs 1 slots
2013-10-31 18:40:42,773 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:42,776 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:42,776 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0027 being deleted.
2013-10-31 18:40:42,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken dst=null perm=null
2013-10-31 18:40:42,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51090, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 306291
2013-10-31 18:40:42,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=null
2013-10-31 18:40:42,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48463, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1728021546, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 382530
2013-10-31 18:40:42,815 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:42,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=null
2013-10-31 18:40:42,832 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51093, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1728021546, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 1145755
2013-10-31 18:40:42,927 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-284700878
2013-10-31 18:40:42,929 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-284700878 spawned.
2013-10-31 18:40:42,931 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000005_0/taskjvm.sh
2013-10-31 18:40:43,533 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_6068750247121428629_1268 blk_-4765952773309717476_1275
2013-10-31 18:40:43,534 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-1380093626912959803_1267 blk_-6217975784485380900_1265
2013-10-31 18:40:44,055 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-284700878 given task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:44,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:44,809 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0027
2013-10-31 18:40:44,809 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0027_m_000001_0 not found in cache
2013-10-31 18:40:44,811 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0027 for user-log deletion with retainTimeStamp:1383331244810
2013-10-31 18:40:45,141 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_m_1809268964 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:45,152 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32203 with signal TERM. Exit code 0
2013-10-31 18:40:45,313 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:45,313 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:45,313 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:45,313 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_m_1809268964 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:40:45,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4765952773309717476_1275 file build/test/data/dfs/data/data2/current/blk_-4765952773309717476 for deletion
2013-10-31 18:40:45,319 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6068750247121428629_1268 file build/test/data/dfs/data/data1/current/blk_6068750247121428629 for deletion
2013-10-31 18:40:45,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4765952773309717476_1275 at file build/test/data/dfs/data/data2/current/blk_-4765952773309717476
2013-10-31 18:40:45,320 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6068750247121428629_1268 at file build/test/data/dfs/data/data1/current/blk_6068750247121428629
2013-10-31 18:40:45,392 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6217975784485380900_1265 file build/test/data/dfs/data/data7/current/blk_-6217975784485380900 for deletion
2013-10-31 18:40:45,393 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1380093626912959803_1267 file build/test/data/dfs/data/data8/current/blk_-1380093626912959803 for deletion
2013-10-31 18:40:45,393 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6217975784485380900_1265 at file build/test/data/dfs/data/data7/current/blk_-6217975784485380900
2013-10-31 18:40:45,393 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1380093626912959803_1267 at file build/test/data/dfs/data/data8/current/blk_-1380093626912959803
2013-10-31 18:40:45,551 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_m_1741630968 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:45,575 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32085 with signal TERM. Exit code 0
2013-10-31 18:40:45,729 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:45,729 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:45,729 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:45,730 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_m_1741630968 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:46,190 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0027_r_95840884 since job job_20131031182606197_0027 is dead
2013-10-31 18:40:46,201 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32267 with signal TERM. Exit code 0
2013-10-31 18:40:46,369 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:40:46,369 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:40:46,369 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:40:46,369 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0027_r_95840884 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:40:47,534 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000005_0 0.0% setup
2013-10-31 18:40:47,537 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000005_0 is done.
2013-10-31 18:40:47,538 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000005_0 was -1
2013-10-31 18:40:47,538 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:48,778 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000005_0' has completed task_20131031182606197_0028_m_000005 successfully.
2013-10-31 18:40:48,782 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000000_0' to tip task_20131031182606197_0028_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:40:48,783 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000000
2013-10-31 18:40:48,786 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000001_0' to tip task_20131031182606197_0028_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:40:48,786 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:40:48,786 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000001
2013-10-31 18:40:48,786 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000000_0 which needs 1 slots
2013-10-31 18:40:48,787 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000000_0 which needs 1 slots
2013-10-31 18:40:48,788 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:40:48,789 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000001_0 which needs 1 slots
2013-10-31 18:40:48,789 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000001_0 which needs 1 slots
2013-10-31 18:40:48,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken dst=null perm=null
2013-10-31 18:40:48,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48185, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_295024924997773881_1284, duration: 303098
2013-10-31 18:40:48,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=null
2013-10-31 18:40:48,809 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44296, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1860863364, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5626442093913306657_1281, duration: 404260
2013-10-31 18:40:48,818 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000002_0' to tip task_20131031182606197_0028_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:40:48,818 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000002
2013-10-31 18:40:48,818 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_474040702
2013-10-31 18:40:48,819 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_474040702 spawned.
2013-10-31 18:40:48,822 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:40:48,823 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000002_0 which needs 1 slots
2013-10-31 18:40:48,824 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000002_0 which needs 1 slots
2013-10-31 18:40:48,824 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000000_0/taskjvm.sh
2013-10-31 18:40:48,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken dst=null perm=null
2013-10-31 18:40:48,830 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51100, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 137280
2013-10-31 18:40:48,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=null
2013-10-31 18:40:48,837 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48473, bytes: 27670, op: HDFS_READ, cliID: DFSClient_-894416312, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 155192
2013-10-31 18:40:48,854 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0028_m_000003_0' to tip task_20131031182606197_0028_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:40:48,861 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=null
2013-10-31 18:40:48,894 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51103, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-894416312, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4010317939662345352_1278, duration: 1460928
2013-10-31 18:40:48,894 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0028_m_000003
2013-10-31 18:40:48,895 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,896 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:40:48,897 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000003_0 which needs 1 slots
2013-10-31 18:40:48,897 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000003_0 which needs 1 slots
2013-10-31 18:40:48,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028/jobToken dst=null perm=null
2013-10-31 18:40:48,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51104, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_295024924997773881_1284, duration: 269492
2013-10-31 18:40:48,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.xml dst=null perm=null
2013-10-31 18:40:48,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48477, bytes: 27670, op: HDFS_READ, cliID: DFSClient_1257678314, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5626442093913306657_1281, duration: 407331
2013-10-31 18:40:48,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=null
2013-10-31 18:40:48,968 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48478, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1860863364, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4010317939662345352_1278, duration: 2293101
2013-10-31 18:40:48,974 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:40:48,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.jar dst=null perm=null
2013-10-31 18:40:48,990 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48196, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1257678314, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4010317939662345352_1278, duration: 588770
2013-10-31 18:40:49,001 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-475802321
2013-10-31 18:40:49,002 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-475802321 spawned.
2013-10-31 18:40:49,003 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000002_0/taskjvm.sh
2013-10-31 18:40:49,021 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-1504316073
2013-10-31 18:40:49,022 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-1504316073 spawned.
2013-10-31 18:40:49,023 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000001_0/taskjvm.sh
2013-10-31 18:40:49,618 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-2144061624
2013-10-31 18:40:49,619 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-2144061624 spawned.
2013-10-31 18:40:49,621 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000003_0/taskjvm.sh
2013-10-31 18:40:49,744 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_474040702 given task: attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=null
2013-10-31 18:40:50,238 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48199, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 171461
2013-10-31 18:40:50,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:40:50,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48200, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 140573
2013-10-31 18:40:50,285 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1489 Total time for transactions(ms): 30Number of transactions batched in Syncs: 127 Number of syncs: 1038 SyncTimes(ms): 68572 16024
2013-10-31 18:40:50,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:50,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:50,482 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000. blk_6468364575429809189_1285
2013-10-31 18:40:50,501 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-475802321 given task: attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:50,506 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:48487 dest: /127.0.0.1:54365
2013-10-31 18:40:50,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:51117 dest: /127.0.0.1:34578
2013-10-31 18:40:50,508 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6468364575429809189_1285 src: /127.0.0.1:44315 dest: /127.0.0.1:59471
2013-10-31 18:40:50,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44315, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6468364575429809189_1285, duration: 1415554
2013-10-31 18:40:50,510 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51117, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6468364575429809189_1285, duration: 1560121
2013-10-31 18:40:50,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48487, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6468364575429809189_1285, duration: 1956243
2013-10-31 18:40:50,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6468364575429809189_1285 terminating
2013-10-31 18:40:50,511 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,512 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,512 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:50,513 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,515 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6468364575429809189_1285 size 264
2013-10-31 18:40:50,556 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:50,557 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000000_0 0.0%
2013-10-31 18:40:50,598 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-1504316073 given task: attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:50,615 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-2144061624 given task: attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=null
2013-10-31 18:40:51,028 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48492, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 169924
2013-10-31 18:40:51,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:40:51,068 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51122, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 164097
2013-10-31 18:40:51,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=null
2013-10-31 18:40:51,099 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48212, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-235108636050631590_1279, duration: 155948
2013-10-31 18:40:51,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:40:51,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028/job.split dst=null perm=null
2013-10-31 18:40:51,159 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48496, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-235108636050631590_1279, duration: 157782
2013-10-31 18:40:51,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:40:51,199 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48497, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 156828
2013-10-31 18:40:51,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:51,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:51,273 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002. blk_1749832804603777904_1288
2013-10-31 18:40:51,296 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:44324 dest: /127.0.0.1:59471
2013-10-31 18:40:51,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:48216 dest: /127.0.0.1:37740
2013-10-31 18:40:51,298 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1749832804603777904_1288 src: /127.0.0.1:51129 dest: /127.0.0.1:34578
2013-10-31 18:40:51,300 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51129, dest: /127.0.0.1:34578, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1749832804603777904_1288, duration: 1366513
2013-10-31 18:40:51,300 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,301 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48216, dest: /127.0.0.1:37740, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1749832804603777904_1288, duration: 1509898
2013-10-31 18:40:51,301 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,301 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44324, dest: /127.0.0.1:59471, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1749832804603777904_1288, duration: 1847903
2013-10-31 18:40:51,301 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1749832804603777904_1288 terminating
2013-10-31 18:40:51,303 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,304 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,305 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1749832804603777904_1288 size 70
2013-10-31 18:40:51,339 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51130, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 162141
2013-10-31 18:40:51,343 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001. blk_-4446515941025710904_1288
2013-10-31 18:40:51,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:51131 dest: /127.0.0.1:34578
2013-10-31 18:40:51,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:44329 dest: /127.0.0.1:59471
2013-10-31 18:40:51,367 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4446515941025710904_1288 src: /127.0.0.1:48504 dest: /127.0.0.1:54365
2013-10-31 18:40:51,369 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48504, dest: /127.0.0.1:54365, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4446515941025710904_1288, duration: 861948
2013-10-31 18:40:51,369 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,369 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,370 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44329, dest: /127.0.0.1:59471, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4446515941025710904_1288, duration: 1215168
2013-10-31 18:40:51,370 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,370 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51131, dest: /127.0.0.1:34578, bytes: 217, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4446515941025710904_1288, duration: 1659449
2013-10-31 18:40:51,370 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4446515941025710904_1288 terminating
2013-10-31 18:40:51,371 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,371 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,371 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,374 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4446515941025710904_1288 size 217
2013-10-31 18:40:51,665 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003. blk_1964692028297874732_1288
2013-10-31 18:40:51,703 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,703 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:51134 dest: /127.0.0.1:34578
2013-10-31 18:40:51,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:48506 dest: /127.0.0.1:54365
2013-10-31 18:40:51,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1964692028297874732_1288 src: /127.0.0.1:44333 dest: /127.0.0.1:59471
2013-10-31 18:40:51,720 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44333, dest: /127.0.0.1:59471, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1964692028297874732_1288, duration: 1610468
2013-10-31 18:40:51,720 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,720 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48506, dest: /127.0.0.1:54365, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1964692028297874732_1288, duration: 3999694
2013-10-31 18:40:51,721 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,721 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51134, dest: /127.0.0.1:34578, bytes: 264, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0028_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1964692028297874732_1288, duration: 4430597
2013-10-31 18:40:51,721 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1964692028297874732_1288 terminating
2013-10-31 18:40:51,722 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,722 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,722 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:51,724 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,724 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1964692028297874732_1288 size 264
2013-10-31 18:40:51,747 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,747 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000001_0 0.0%
2013-10-31 18:40:51,755 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,755 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000002_0 0.0%
2013-10-31 18:40:51,766 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0028_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:40:51,766 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000003_0 0.0%
2013-10-31 18:40:51,788 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000000_0
2013-10-31 18:40:51,792 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000001_0
2013-10-31 18:40:51,825 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000002_0
2013-10-31 18:40:51,901 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0028_m_000003_0
2013-10-31 18:40:52,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0 dst=null perm=null
2013-10-31 18:40:52,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0/part-00000 dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000000_0 dst=null perm=null
2013-10-31 18:40:52,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0 dst=null perm=null
2013-10-31 18:40:52,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0 dst=null perm=null
2013-10-31 18:40:52,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0/part-00001 dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0 dst=null perm=null
2013-10-31 18:40:52,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000001_0 dst=null perm=null
2013-10-31 18:40:52,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:40:52,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0/part-00002 dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,782 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-3853691654878838440_1011
2013-10-31 18:40:52,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000002_0 dst=null perm=null
2013-10-31 18:40:52,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0/part-00003 dst=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:52,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary/_attempt_20131031182606197_0028_m_000003_0 dst=null perm=null
2013-10-31 18:40:53,167 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:40:53,169 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000000_0 is done.
2013-10-31 18:40:53,169 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000000_0 was -1
2013-10-31 18:40:53,170 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:53,787 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:53,787 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0028_m_000005_0
2013-10-31 18:40:53,787 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000005_0 not found in cache
2013-10-31 18:40:53,956 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:40:53,957 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000002_0 is done.
2013-10-31 18:40:53,958 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000002_0 was -1
2013-10-31 18:40:53,958 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,021 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:40:54,022 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000001_0 is done.
2013-10-31 18:40:54,022 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000001_0 was -1
2013-10-31 18:40:54,022 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,085 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:40:54,086 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000003_0 is done.
2013-10-31 18:40:54,086 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000003_0 was -1
2013-10-31 18:40:54,087 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:40:54,792 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000000_0' has completed task_20131031182606197_0028_m_000000 successfully.
2013-10-31 18:40:54,794 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000001_0' has completed task_20131031182606197_0028_m_000001 successfully.
2013-10-31 18:40:54,828 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000002_0' has completed task_20131031182606197_0028_m_000002 successfully.
2013-10-31 18:40:54,904 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000003_0' has completed task_20131031182606197_0028_m_000003 successfully.
2013-10-31 18:40:54,906 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0028_m_000004_0' to tip task_20131031182606197_0028_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:40:54,909 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0028_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:40:54,909 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0028_m_000004_0 which needs 1 slots
2013-10-31 18:40:54,909 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0028_m_000004_0 which needs 1 slots
2013-10-31 18:40:54,947 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0028_m_-1006496814
2013-10-31 18:40:54,948 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0028_m_-1006496814 spawned.
2013-10-31 18:40:54,950 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0028/attempt_20131031182606197_0028_m_000004_0/taskjvm.sh
2013-10-31 18:40:55,926 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0028_m_-1006496814 given task: attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:55,999 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:40:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,010 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:40:56,032 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:40:56,439 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000004_0 0.0%
2013-10-31 18:40:57,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_temporary dst=null perm=null
2013-10-31 18:40:57,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:40:57,305 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS from client DFSClient_attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:57,305 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0028_m_000004_0
2013-10-31 18:40:57,311 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,312 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,312 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,312 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4010317939662345352 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,312 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,313 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,313 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,313 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-235108636050631590 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,313 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,313 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:40:57,314 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2267545822353736092 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,314 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:40:57,314 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:40:57,314 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5626442093913306657 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:40:57,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0028 dst=null perm=null
2013-10-31 18:40:58,536 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_-2267545822353736092_1280
2013-10-31 18:40:58,536 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_-2267545822353736092_1280
2013-10-31 18:40:59,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data4/current/blk_-4010317939662345352 for deletion
2013-10-31 18:40:59,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data4/current/blk_-2267545822353736092 for deletion
2013-10-31 18:40:59,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data3/current/blk_-235108636050631590 for deletion
2013-10-31 18:40:59,199 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data4/current/blk_-4010317939662345352
2013-10-31 18:40:59,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data3/current/blk_-235108636050631590
2013-10-31 18:40:59,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data4/current/blk_-2267545822353736092
2013-10-31 18:40:59,200 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data3/current/blk_5626442093913306657 for deletion
2013-10-31 18:40:59,201 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data3/current/blk_5626442093913306657
2013-10-31 18:40:59,373 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0028_m_000004_0 0.0% cleanup
2013-10-31 18:40:59,375 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0028_m_000004_0 is done.
2013-10-31 18:40:59,375 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0028_m_000004_0 was -1
2013-10-31 18:40:59,376 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:00,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data2/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:00,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data2/current/blk_-2267545822353736092 for deletion
2013-10-31 18:41:00,325 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data1/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:00,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data2/current/blk_-4010317939662345352
2013-10-31 18:41:00,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data1/current/blk_-235108636050631590
2013-10-31 18:41:00,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data2/current/blk_-2267545822353736092
2013-10-31 18:41:00,917 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0028_m_000004_0' has completed task_20131031182606197_0028_m_000004 successfully.
2013-10-31 18:41:00,918 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0028 has completed successfully.
2013-10-31 18:41:00,918 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0028,submitTime=1383244840735,launchTime=1383244840831,firstMapTaskLaunchTime=1383244848782,firstJobSetupTaskLaunchTime=1383244842765,firstJobCleanupTaskLaunchTime=1383244854906,finishTime=1383244860918,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=27,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AA2052F0D79D45CC875DDB141C76CED5/05016FD470A8431585730710D69FB2A9] merged/(1/2)
2013-10-31 18:41:00,923 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315. blk_6893710486870095770_1289
2013-10-31 18:41:00,925 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:48512 dest: /127.0.0.1:54365
2013-10-31 18:41:00,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:48230 dest: /127.0.0.1:37740
2013-10-31 18:41:00,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6893710486870095770_1289 src: /127.0.0.1:51143 dest: /127.0.0.1:34578
2013-10-31 18:41:00,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51143, dest: /127.0.0.1:34578, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6893710486870095770_1289, duration: 305840
2013-10-31 18:41:00,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48230, dest: /127.0.0.1:37740, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6893710486870095770_1289, duration: 1295568
2013-10-31 18:41:00,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,975 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48512, dest: /127.0.0.1:54365, bytes: 22419, op: HDFS_WRITE, cliID: DFSClient_489287705, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6893710486870095770_1289, duration: 2366979
2013-10-31 18:41:00,976 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6893710486870095770_1289 terminating
2013-10-31 18:41:00,980 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,981 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 from client DFSClient_489287705
2013-10-31 18:41:00,981 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/_logs/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 is closed by DFSClient_489287705
2013-10-31 18:41:00,982 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6893710486870095770_1289 size 22419
2013-10-31 18:41:00,990 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0028_1383244840735_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F05016FD470A84315 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:00,991 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000003_0'
2013-10-31 18:41:00,991 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000004_0'
2013-10-31 18:41:00,992 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:00,992 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:00,992 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_295024924997773881 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:00,994 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] starting step: (2/2) ...splitsourcemergedsamename
2013-10-31 18:41:00,997 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0028_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:00,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0028 dst=null perm=null
2013-10-31 18:41:01,035 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:41:01,035 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:41:01,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:01,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:41:01,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:01,057 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar. blk_1804964651075253424_1290
2013-10-31 18:41:01,058 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:48516 dest: /127.0.0.1:54365
2013-10-31 18:41:01,060 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:44343 dest: /127.0.0.1:59471
2013-10-31 18:41:01,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:48235 dest: /127.0.0.1:37740
2013-10-31 18:41:01,069 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48235, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 4946033
2013-10-31 18:41:01,069 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,070 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44343, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1804964651075253424_1290, duration: 5383409
2013-10-31 18:41:01,070 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,070 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48516, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1804964651075253424_1290, duration: 6002253
2013-10-31 18:41:01,071 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1804964651075253424_1290 terminating
2013-10-31 18:41:01,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,072 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar from client DFSClient_-1596270109
2013-10-31 18:41:01,072 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:41:01,073 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,074 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:01,078 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar. New replication is 10
2013-10-31 18:41:01,537 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_1804964651075253424_1290 to datanode(s) 127.0.0.1:34578
2013-10-31 18:41:01,537 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_295024924997773881_1284
2013-10-31 18:41:01,538 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_295024924997773881_1284
2013-10-31 18:41:02,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=null
2013-10-31 18:41:02,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,779 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:41:02,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=null
2013-10-31 18:41:02,784 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:41:02,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000 dst=null perm=null
2013-10-31 18:41:02,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001 dst=null perm=null
2013-10-31 18:41:02,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002 dst=null perm=null
2013-10-31 18:41:02,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003 dst=null perm=null
2013-10-31 18:41:02,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,801 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split. New replication is 10
2013-10-31 18:41:02,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=null
2013-10-31 18:41:02,810 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split. blk_-2443861200343278733_1291
2013-10-31 18:41:02,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:48236 dest: /127.0.0.1:37740
2013-10-31 18:41:02,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:51149 dest: /127.0.0.1:34578
2013-10-31 18:41:02,815 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:48521 dest: /127.0.0.1:54365
2013-10-31 18:41:02,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2443861200343278733_1291 src: /127.0.0.1:44348 dest: /127.0.0.1:59471
2013-10-31 18:41:02,820 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44348, dest: /127.0.0.1:59471, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 120213
2013-10-31 18:41:02,821 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,821 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48521, dest: /127.0.0.1:54365, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2443861200343278733_1291, duration: 989064
2013-10-31 18:41:02,822 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,822 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51149, dest: /127.0.0.1:34578, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2443861200343278733_1291, duration: 1899330
2013-10-31 18:41:02,822 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,823 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,823 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48236, dest: /127.0.0.1:37740, bytes: 1387, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2443861200343278733_1291, duration: 2954898
2013-10-31 18:41:02,824 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,824 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2443861200343278733_1291 terminating
2013-10-31 18:41:02,828 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,829 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split from client DFSClient_-1596270109
2013-10-31 18:41:02,829 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split is closed by DFSClient_-1596270109
2013-10-31 18:41:02,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2443861200343278733_1291 size 1387
2013-10-31 18:41:02,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,847 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo. blk_-1212781167072705890_1292
2013-10-31 18:41:02,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:44349 dest: /127.0.0.1:59471
2013-10-31 18:41:02,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:48524 dest: /127.0.0.1:54365
2013-10-31 18:41:02,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1212781167072705890_1292 src: /127.0.0.1:51154 dest: /127.0.0.1:34578
2013-10-31 18:41:02,854 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51154, dest: /127.0.0.1:34578, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1212781167072705890_1292, duration: 66400
2013-10-31 18:41:02,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48524, dest: /127.0.0.1:54365, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1212781167072705890_1292, duration: 1017451
2013-10-31 18:41:02,856 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,856 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,856 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44349, dest: /127.0.0.1:59471, bytes: 153, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1212781167072705890_1292, duration: 1974738
2013-10-31 18:41:02,856 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,857 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1212781167072705890_1292 terminating
2013-10-31 18:41:02,859 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:41:02,860 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:41:02,861 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1212781167072705890_1292 size 153
2013-10-31 18:41:02,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,885 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml. blk_243604678923041825_1293
2013-10-31 18:41:02,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:48526 dest: /127.0.0.1:54365
2013-10-31 18:41:02,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:51156 dest: /127.0.0.1:34578
2013-10-31 18:41:02,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_243604678923041825_1293 src: /127.0.0.1:48245 dest: /127.0.0.1:37740
2013-10-31 18:41:02,892 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48245, dest: /127.0.0.1:37740, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_243604678923041825_1293, duration: 68596
2013-10-31 18:41:02,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,893 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,893 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51156, dest: /127.0.0.1:34578, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 868089
2013-10-31 18:41:02,894 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48526, dest: /127.0.0.1:54365, bytes: 28283, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_243604678923041825_1293, duration: 1804151
2013-10-31 18:41:02,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_243604678923041825_1293 terminating
2013-10-31 18:41:02,896 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,897 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml from client DFSClient_-1596270109
2013-10-31 18:41:02,897 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:41:02,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_243604678923041825_1293 size 28283
2013-10-31 18:41:02,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=null
2013-10-31 18:41:02,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51159, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 398172
2013-10-31 18:41:02,929 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_1804964651075253424_1290 to 127.0.0.1:34578
2013-10-31 18:41:02,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data6/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:02,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data5/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:02,929 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data5/current/blk_295024924997773881 for deletion
2013-10-31 18:41:02,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data6/current/blk_5626442093913306657 for deletion
2013-10-31 18:41:02,930 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0029: nMaps=4 nReduces=1 max=-1
2013-10-31 18:41:02,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data5/current/blk_-235108636050631590
2013-10-31 18:41:02,930 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0029
2013-10-31 18:41:02,930 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0029 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:41:02,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data5/current/blk_295024924997773881
2013-10-31 18:41:02,930 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data6/current/blk_-4010317939662345352
2013-10-31 18:41:02,931 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_1804964651075253424_1290 to /127.0.0.1:34578
2013-10-31 18:41:02,930 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0029 RESULT=SUCCESS
2013-10-31 18:41:02,930 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0029
2013-10-31 18:41:02,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1804964651075253424_1290 src: /127.0.0.1:51160 dest: /127.0.0.1:34578
2013-10-31 18:41:02,931 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data6/current/blk_5626442093913306657
2013-10-31 18:41:02,932 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [merged] submitted hadoop job: job_20131031182606197_0029
2013-10-31 18:41:02,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1804964651075253424_1290 src: /127.0.0.1:51160 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:41:02,936 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1804964651075253424_1290 size 238055
2013-10-31 18:41:02,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,950 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml. blk_-3916428015842641732_1295
2013-10-31 18:41:02,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:48249 dest: /127.0.0.1:37740
2013-10-31 18:41:02,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:51162 dest: /127.0.0.1:34578
2013-10-31 18:41:02,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3916428015842641732_1295 src: /127.0.0.1:44360 dest: /127.0.0.1:59471
2013-10-31 18:41:02,956 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44360, dest: /127.0.0.1:59471, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3916428015842641732_1295, duration: 2043794
2013-10-31 18:41:02,957 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,957 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51162, dest: /127.0.0.1:34578, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3916428015842641732_1295, duration: 1107174
2013-10-31 18:41:02,957 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,957 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48249, dest: /127.0.0.1:37740, bytes: 28348, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3916428015842641732_1295, duration: 2473471
2013-10-31 18:41:02,957 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3916428015842641732_1295 terminating
2013-10-31 18:41:02,960 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,960 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml from client DFSClient_1275874167
2013-10-31 18:41:02,960 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_conf.xml is closed by DFSClient_1275874167
2013-10-31 18:41:02,961 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,961 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3916428015842641732_1295 size 28348
2013-10-31 18:41:02,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:02,976 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken. blk_8785549613552392148_1296
2013-10-31 18:41:02,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:44361 dest: /127.0.0.1:59471
2013-10-31 18:41:02,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:48536 dest: /127.0.0.1:54365
2013-10-31 18:41:02,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8785549613552392148_1296 src: /127.0.0.1:48254 dest: /127.0.0.1:37740
2013-10-31 18:41:02,983 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48254, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8785549613552392148_1296, duration: 68599
2013-10-31 18:41:02,984 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,984 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48536, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8785549613552392148_1296, duration: 872934
2013-10-31 18:41:02,985 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,985 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44361, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 1833765
2013-10-31 18:41:02,986 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8785549613552392148_1296 terminating
2013-10-31 18:41:02,989 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:02,990 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken from client DFSClient_-1596270109
2013-10-31 18:41:02,990 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:41:02,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:02,991 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8785549613552392148_1296 size 116
2013-10-31 18:41:03,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data2/current/blk_295024924997773881 for deletion
2013-10-31 18:41:03,326 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data2/current/blk_295024924997773881
2013-10-31 18:41:03,520 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken
2013-10-31 18:41:03,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.splitmetainfo dst=null perm=null
2013-10-31 18:41:03,525 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44364, bytes: 157, op: HDFS_READ, cliID: DFSClient_1275874167, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1212781167072705890_1292, duration: 284578
2013-10-31 18:41:03,526 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0029 = 815. Number of splits = 4
2013-10-31 18:41:03,526 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,527 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,528 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0029_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:03,529 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0029 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:41:03,530 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0029 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:41:03,804 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0029_m_000005_0' to tip task_20131031182606197_0029_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:03,811 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000000_0'
2013-10-31 18:41:03,811 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000005_0'
2013-10-31 18:41:03,814 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:41:03,814 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000001_0'
2013-10-31 18:41:03,815 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000005_0 which needs 1 slots
2013-10-31 18:41:03,815 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000005_0 which needs 1 slots
2013-10-31 18:41:03,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken dst=null perm=null
2013-10-31 18:41:03,823 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48256, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8785549613552392148_1296, duration: 305137
2013-10-31 18:41:03,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=null
2013-10-31 18:41:03,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48541, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1704203369, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_243604678923041825_1293, duration: 389766
2013-10-31 18:41:03,838 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0028_m_000002_0'
2013-10-31 18:41:03,860 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:03,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=null
2013-10-31 18:41:03,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48259, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1704203369, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 1471266
2013-10-31 18:41:03,987 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0028_m_474040702
2013-10-31 18:41:03,995 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32565 with signal TERM. Exit code 0
2013-10-31 18:41:03,995 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_1993047584
2013-10-31 18:41:03,995 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_1993047584 spawned.
2013-10-31 18:41:03,999 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000005_0/taskjvm.sh
2013-10-31 18:41:04,214 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:04,215 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:04,215 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:04,215 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_474040702 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:04,538 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_5626442093913306657_1281 blk_-235108636050631590_1279 blk_-4010317939662345352_1278 blk_295024924997773881_1284 blk_-2267545822353736092_1280
2013-10-31 18:41:04,983 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1993047584 given task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:05,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:05,992 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:05,993 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000004_0 not found in cache
2013-10-31 18:41:05,993 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000003_0 not found in cache
2013-10-31 18:41:05,994 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331265994
2013-10-31 18:41:06,400 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4010317939662345352_1278 file build/test/data/dfs/data/data8/current/blk_-4010317939662345352 for deletion
2013-10-31 18:41:06,400 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2267545822353736092_1280 file build/test/data/dfs/data/data8/current/blk_-2267545822353736092 for deletion
2013-10-31 18:41:06,400 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-235108636050631590_1279 file build/test/data/dfs/data/data7/current/blk_-235108636050631590 for deletion
2013-10-31 18:41:06,401 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4010317939662345352_1278 at file build/test/data/dfs/data/data8/current/blk_-4010317939662345352
2013-10-31 18:41:06,401 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_295024924997773881_1284 file build/test/data/dfs/data/data7/current/blk_295024924997773881 for deletion
2013-10-31 18:41:06,401 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2267545822353736092_1280 at file build/test/data/dfs/data/data8/current/blk_-2267545822353736092
2013-10-31 18:41:06,401 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5626442093913306657_1281 file build/test/data/dfs/data/data7/current/blk_5626442093913306657 for deletion
2013-10-31 18:41:06,401 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-235108636050631590_1279 at file build/test/data/dfs/data/data7/current/blk_-235108636050631590
2013-10-31 18:41:06,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_295024924997773881_1284 at file build/test/data/dfs/data/data7/current/blk_295024924997773881
2013-10-31 18:41:06,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5626442093913306657_1281 at file build/test/data/dfs/data/data7/current/blk_5626442093913306657
2013-10-31 18:41:06,643 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-2144061624 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:06,654 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32676 with signal TERM. Exit code 0
2013-10-31 18:41:06,845 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:06,845 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:06,845 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:06,846 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-2144061624 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:07,458 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-1006496814 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:07,468 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group436 with signal TERM. Exit code 0
2013-10-31 18:41:07,647 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:07,648 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:07,648 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:07,648 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-1006496814 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:08,431 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000005_0 0.0% setup
2013-10-31 18:41:08,433 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000005_0 is done.
2013-10-31 18:41:08,434 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000005_0 was -1
2013-10-31 18:41:08,434 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:08,815 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,815 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000000_0 not found in cache
2013-10-31 18:41:08,815 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,816 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000001_0 not found in cache
2013-10-31 18:41:08,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268816
2013-10-31 18:41:08,816 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268816
2013-10-31 18:41:08,839 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0028
2013-10-31 18:41:08,840 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0028_m_000002_0 not found in cache
2013-10-31 18:41:08,840 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0028 for user-log deletion with retainTimeStamp:1383331268840
2013-10-31 18:41:09,122 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-284700878 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,132 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32443 with signal TERM. Exit code 0
2013-10-31 18:41:09,417 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,417 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,417 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:09,417 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-284700878 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,533 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-475802321 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,544 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32639 with signal TERM. Exit code 0
2013-10-31 18:41:09,574 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0028_m_-1504316073 since job job_20131031182606197_0028 is dead
2013-10-31 18:41:09,582 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group32677 with signal TERM. Exit code 0
2013-10-31 18:41:09,750 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,750 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,750 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:09,750 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-475802321 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,756 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:09,756 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:09,757 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:09,757 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0028_m_-1504316073 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:09,819 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000005_0' has completed task_20131031182606197_0029_m_000005 successfully.
2013-10-31 18:41:09,822 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000000_0' to tip task_20131031182606197_0029_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:09,823 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000000
2013-10-31 18:41:09,824 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000001_0' to tip task_20131031182606197_0029_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:09,824 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000001
2013-10-31 18:41:09,825 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:09,825 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000000_0 which needs 1 slots
2013-10-31 18:41:09,825 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000000_0 which needs 1 slots
2013-10-31 18:41:09,826 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:41:09,826 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000001_0 which needs 1 slots
2013-10-31 18:41:09,827 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000001_0 which needs 1 slots
2013-10-31 18:41:09,831 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:41:09,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken dst=null perm=null
2013-10-31 18:41:09,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44371, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 145993
2013-10-31 18:41:09,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=null
2013-10-31 18:41:09,843 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48264, bytes: 28507, op: HDFS_READ, cliID: DFSClient_-1474656826, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_243604678923041825_1293, duration: 215670
2013-10-31 18:41:09,844 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000002_0' to tip task_20131031182606197_0029_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:09,844 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000002
2013-10-31 18:41:09,852 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:41:09,852 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000002_0 which needs 1 slots
2013-10-31 18:41:09,852 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000002_0 which needs 1 slots
2013-10-31 18:41:09,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken dst=null perm=null
2013-10-31 18:41:09,858 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44374, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8785549613552392148_1296, duration: 307036
2013-10-31 18:41:09,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=null
2013-10-31 18:41:09,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51179, bytes: 28507, op: HDFS_READ, cliID: DFSClient_-446861028, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 182515
2013-10-31 18:41:09,864 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:09,871 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_1939526561
2013-10-31 18:41:09,872 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_1939526561 spawned.
2013-10-31 18:41:09,874 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000000_0/taskjvm.sh
2013-10-31 18:41:09,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=null
2013-10-31 18:41:09,886 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48268, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1474656826, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1804964651075253424_1290, duration: 851526
2013-10-31 18:41:09,949 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-1898251875
2013-10-31 18:41:09,950 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-1898251875 spawned.
2013-10-31 18:41:09,951 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000001_0/taskjvm.sh
2013-10-31 18:41:09,982 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:10,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=null
2013-10-31 18:41:10,002 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0029_m_000003_0' to tip task_20131031182606197_0029_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:41:10,003 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0029_m_000003
2013-10-31 18:41:10,004 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:41:10,005 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000003_0 which needs 1 slots
2013-10-31 18:41:10,005 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000003_0 which needs 1 slots
2013-10-31 18:41:10,007 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48552, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-446861028, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1804964651075253424_1290, duration: 1775973
2013-10-31 18:41:10,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029/jobToken dst=null perm=null
2013-10-31 18:41:10,011 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48553, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8785549613552392148_1296, duration: 144693
2013-10-31 18:41:10,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.xml dst=null perm=null
2013-10-31 18:41:10,020 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51184, bytes: 28507, op: HDFS_READ, cliID: DFSClient_1761917186, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_243604678923041825_1293, duration: 158296
2013-10-31 18:41:10,038 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:10,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.jar dst=null perm=null
2013-10-31 18:41:10,052 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51185, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1761917186, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1804964651075253424_1290, duration: 596392
2013-10-31 18:41:10,307 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-1471644336
2013-10-31 18:41:10,308 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-1471644336 spawned.
2013-10-31 18:41:10,308 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_m_-512352330
2013-10-31 18:41:10,309 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_m_-512352330 spawned.
2013-10-31 18:41:10,309 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000002_0/taskjvm.sh
2013-10-31 18:41:10,310 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_m_000003_0/taskjvm.sh
2013-10-31 18:41:10,837 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1939526561 given task: attempt_20131031182606197_0029_m_000000_0
2013-10-31 18:41:11,144 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-1898251875 given task: attempt_20131031182606197_0029_m_000001_0
2013-10-31 18:41:11,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=null
2013-10-31 18:41:11,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48277, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2443861200343278733_1291, duration: 176015
2013-10-31 18:41:11,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000 dst=null perm=null
2013-10-31 18:41:11,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51190, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6468364575429809189_1285, duration: 125115
2013-10-31 18:41:11,599 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-1471644336 given task: attempt_20131031182606197_0029_m_000002_0
2013-10-31 18:41:11,605 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_-512352330 given task: attempt_20131031182606197_0029_m_000003_0
2013-10-31 18:41:11,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=null
2013-10-31 18:41:11,645 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44391, bytes: 1399, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 169898
2013-10-31 18:41:11,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003 dst=null perm=null
2013-10-31 18:41:11,684 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48566, bytes: 268, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1964692028297874732_1288, duration: 142287
2013-10-31 18:41:12,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=null
2013-10-31 18:41:12,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44395, bytes: 883, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2443861200343278733_1291, duration: 163331
2013-10-31 18:41:12,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029/job.split dst=null perm=null
2013-10-31 18:41:12,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51199, bytes: 367, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2443861200343278733_1291, duration: 120595
2013-10-31 18:41:12,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001 dst=null perm=null
2013-10-31 18:41:12,136 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48571, bytes: 221, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4446515941025710904_1288, duration: 108699
2013-10-31 18:41:12,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002 dst=null perm=null
2013-10-31 18:41:12,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48289, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0029_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1749832804603777904_1288, duration: 111309
2013-10-31 18:41:14,263 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00000:0+264
2013-10-31 18:41:14,266 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000000_0 is done.
2013-10-31 18:41:14,266 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000000_0 was 196
2013-10-31 18:41:14,267 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:14,574 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000001_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00003:0+264
2013-10-31 18:41:14,576 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000001_0 is done.
2013-10-31 18:41:14,577 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000001_0 was 196
2013-10-31 18:41:14,577 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:14,825 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:14,825 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0029_m_000005_0
2013-10-31 18:41:14,826 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0029_m_000005_0 not found in cache
2013-10-31 18:41:15,024 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000002_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00001:0+217
2013-10-31 18:41:15,027 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000002_0 is done.
2013-10-31 18:41:15,027 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000002_0 was 149
2013-10-31 18:41:15,027 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:15,048 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000003_0 0.0% hdfs://localhost:34237/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75/part-00002:0+70
2013-10-31 18:41:15,050 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000003_0 is done.
2013-10-31 18:41:15,050 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000003_0 was 6
2013-10-31 18:41:15,050 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:15,831 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000000_0' has completed task_20131031182606197_0029_m_000000 successfully.
2013-10-31 18:41:15,833 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0029_r_000000_0' to tip task_20131031182606197_0029_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:15,834 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000001_0' has completed task_20131031182606197_0029_m_000001 successfully.
2013-10-31 18:41:15,835 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:15,836 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_r_000000_0 which needs 1 slots
2013-10-31 18:41:15,836 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_r_000000_0 which needs 1 slots
2013-10-31 18:41:15,854 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000002_0' has completed task_20131031182606197_0029_m_000002 successfully.
2013-10-31 18:41:15,873 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0029_r_1027368877
2013-10-31 18:41:15,874 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0029_r_1027368877 spawned.
2013-10-31 18:41:15,876 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0029/attempt_20131031182606197_0029_r_000000_0/taskjvm.sh
2013-10-31 18:41:16,003 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 19
2013-10-31 18:41:16,010 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000003_0' has completed task_20131031182606197_0029_m_000003 successfully.
2013-10-31 18:41:16,833 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_r_1027368877 given task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:22,501 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42607, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000000_0, duration: 5825534
2013-10-31 18:41:22,516 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45284, bytes: 196, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000001_0, duration: 8828885
2013-10-31 18:41:22,534 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50243, bytes: 149, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000002_0, duration: 11613521
2013-10-31 18:41:22,551 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40589, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0029_m_000003_0, duration: 12253620
2013-10-31 18:41:23,315 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,375 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,426 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:23,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:23,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:23,653 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000. blk_4451671807219443706_1297
2013-10-31 18:41:23,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:48297 dest: /127.0.0.1:37740
2013-10-31 18:41:23,696 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:44407 dest: /127.0.0.1:59471
2013-10-31 18:41:23,697 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4451671807219443706_1297 src: /127.0.0.1:48582 dest: /127.0.0.1:54365
2013-10-31 18:41:23,701 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48582, dest: /127.0.0.1:54365, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4451671807219443706_1297, duration: 2769818
2013-10-31 18:41:23,701 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,701 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44407, dest: /127.0.0.1:59471, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4451671807219443706_1297, duration: 3163948
2013-10-31 18:41:23,701 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,702 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48297, dest: /127.0.0.1:37740, bytes: 495, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0029_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4451671807219443706_1297, duration: 3530635
2013-10-31 18:41:23,702 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4451671807219443706_1297 terminating
2013-10-31 18:41:23,705 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,705 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,705 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:23,705 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:23,706 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4451671807219443706_1297 size 495
2013-10-31 18:41:23,741 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0029_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:41:23,741 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:41:24,845 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0029_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:41:24,846 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:25,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0 dst=null perm=null
2013-10-31 18:41:25,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:25,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:25,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary/_attempt_20131031182606197_0029_r_000000_0 dst=null perm=null
2013-10-31 18:41:26,368 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:26,370 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:26,371 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_r_000000_0 is done.
2013-10-31 18:41:26,371 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_r_000000_0 was -1
2013-10-31 18:41:26,372 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:27,850 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_r_000000_0' has completed task_20131031182606197_0029_r_000000 successfully.
2013-10-31 18:41:27,853 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0029_m_000004_0' to tip task_20131031182606197_0029_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:27,855 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0029_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:41:27,855 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0029_m_000004_0 which needs 1 slots
2013-10-31 18:41:27,856 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0029_m_000004_0 which needs 1 slots
2013-10-31 18:41:27,892 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0029/attempt_20131031182606197_0029_m_000004_0. Attempting to reuse: jvm_20131031182606197_0029_m_1993047584
2013-10-31 18:41:28,520 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0029_m_1993047584 given task: attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,638 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000004_0 0.0%
2013-10-31 18:41:28,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary dst=null perm=null
2013-10-31 18:41:28,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:28,659 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS from client DFSClient_attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,659 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0029_m_000004_0
2013-10-31 18:41:28,663 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,663 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,663 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1804964651075253424 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2443861200343278733 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1212781167072705890 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:28,664 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_243604678923041825 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:28,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0029 dst=null perm=null
2013-10-31 18:41:31,542 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1804964651075253424_1290 blk_243604678923041825_1293
2013-10-31 18:41:31,543 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-2443861200343278733_1291 blk_1804964651075253424_1290 blk_243604678923041825_1293
2013-10-31 18:41:31,607 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0029_m_000004_0 0.0% cleanup
2013-10-31 18:41:31,609 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0029_m_000004_0 is done.
2013-10-31 18:41:31,609 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0029_m_000004_0 was -1
2013-10-31 18:41:31,609 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:32,856 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:32,856 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0029_r_000000_0
2013-10-31 18:41:33,336 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data2/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:33,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data1/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:33,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data2/current/blk_-2443861200343278733
2013-10-31 18:41:33,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data1/current/blk_-1212781167072705890
2013-10-31 18:41:33,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data2/current/blk_243604678923041825 for deletion
2013-10-31 18:41:33,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data2/current/blk_243604678923041825
2013-10-31 18:41:33,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data1/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:33,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data1/current/blk_1804964651075253424
2013-10-31 18:41:33,408 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data8/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:33,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data7/current/blk_243604678923041825 for deletion
2013-10-31 18:41:33,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data8/current/blk_-2443861200343278733
2013-10-31 18:41:33,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data7/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:33,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data7/current/blk_243604678923041825
2013-10-31 18:41:33,410 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data7/current/blk_1804964651075253424
2013-10-31 18:41:33,863 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0029_m_000004_0' has completed task_20131031182606197_0029_m_000004 successfully.
2013-10-31 18:41:33,864 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0029 has completed successfully.
2013-10-31 18:41:33,865 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0029,submitTime=1383244862902,launchTime=1383244863529,firstMapTaskLaunchTime=1383244869822,firstReduceTaskLaunchTime=1383244875832,firstJobSetupTaskLaunchTime=1383244863804,firstJobCleanupTaskLaunchTime=1383244887852,finishTime=1383244893864,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=26,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[AA2052F0D79D45CC875DDB141C76CED5/106D7E74095247668E8A8F32E6B51F99] merged/(2/2) ...splitsourcemergedsamename
2013-10-31 18:41:33,871 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766. blk_800740813804517052_1298
2013-10-31 18:41:33,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:51217 dest: /127.0.0.1:34578
2013-10-31 18:41:33,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:48306 dest: /127.0.0.1:37740
2013-10-31 18:41:33,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_800740813804517052_1298 src: /127.0.0.1:48590 dest: /127.0.0.1:54365
2013-10-31 18:41:33,893 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48590, dest: /127.0.0.1:54365, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_800740813804517052_1298, duration: 5540407
2013-10-31 18:41:33,893 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48306, dest: /127.0.0.1:37740, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_800740813804517052_1298, duration: 5403742
2013-10-31 18:41:33,894 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51217, dest: /127.0.0.1:34578, bytes: 27806, op: HDFS_WRITE, cliID: DFSClient_1275874167, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_800740813804517052_1298, duration: 7241652
2013-10-31 18:41:33,896 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_800740813804517052_1298 terminating
2013-10-31 18:41:33,901 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,903 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 from client DFSClient_1275874167
2013-10-31 18:41:33,904 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_logs/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 is closed by DFSClient_1275874167
2013-10-31 18:41:33,904 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,904 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_800740813804517052_1298 size 27806
2013-10-31 18:41:33,911 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0029_1383244862902_hadoop_%5BAA2052F0D79D45CC875DDB141C76CED5%2F106D7E7409524766 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:33,912 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000000_0'
2013-10-31 18:41:33,912 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000004_0'
2013-10-31 18:41:33,913 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000005_0'
2013-10-31 18:41:33,913 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_r_000000_0'
2013-10-31 18:41:33,914 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,914 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,914 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000002_0'
2013-10-31 18:41:33,914 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8785549613552392148 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,915 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000001_0'
2013-10-31 18:41:33,917 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0029_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:41:33,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,921 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,922 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6893710486870095770 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,922 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,922 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0029 dst=null perm=null
2013-10-31 18:41:33,922 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-566339595978537805 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6468364575429809189 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,923 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,924 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,924 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4446515941025710904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,924 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,924 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,925 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1749832804603777904 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:41:33,925 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:41:33,925 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:41:33,925 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1964692028297874732 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:41:33,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/2236418751_split_97D3A09791F4465FA19CAD542C970E75 dst=null perm=null
2013-10-31 18:41:33,931 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/_temporary
2013-10-31 18:41:33,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename dst=null perm=null
2013-10-31 18:41:33,951 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:33,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000 dst=null perm=null
2013-10-31 18:41:33,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000 dst=null perm=null
2013-10-31 18:41:33,954 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48592, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4451671807219443706_1297, duration: 127438
2013-10-31 18:41:33,954 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitsourcemergedsamename
2013-10-31 18:41:33,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename dst=null perm=null
2013-10-31 18:41:33,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitsourcemergedsamename/part-00000 dst=null perm=null
2013-10-31 18:41:33,960 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44419, bytes: 499, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4451671807219443706_1297, duration: 288340
2013-10-31 18:41:33,970 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:41:33,970 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:41:33,990 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] starting
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] source: Hfs["TextDelimited[['num', 'char']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic"]
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] parallel execution is enabled: true
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] starting jobs: 1
2013-10-31 18:41:33,991 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper] allocating threads: 1
2013-10-31 18:41:33,992 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper] starting step: (1/1) ...grouping-nondeterministic
2013-10-31 18:41:33,994 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:41:33,994 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:41:33,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:34,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:41:34,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,007 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar. blk_-3274370513633766733_1299
2013-10-31 18:41:34,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:44420 dest: /127.0.0.1:59471
2013-10-31 18:41:34,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:48312 dest: /127.0.0.1:37740
2013-10-31 18:41:34,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:51225 dest: /127.0.0.1:34578
2013-10-31 18:41:34,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51225, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3274370513633766733_1299, duration: 3793639
2013-10-31 18:41:34,017 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48312, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3274370513633766733_1299, duration: 4491690
2013-10-31 18:41:34,017 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44420, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3274370513633766733_1299, duration: 5064586
2013-10-31 18:41:34,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3274370513633766733_1299 terminating
2013-10-31 18:41:34,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,022 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar from client DFSClient_-1596270109
2013-10-31 18:41:34,022 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:41:34,022 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:34,027 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar. New replication is 10
2013-10-31 18:41:34,028 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0029_m_000003_0'
2013-10-31 18:41:34,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=null
2013-10-31 18:41:34,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,285 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:41:34,290 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:41:34,293 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:41:34,296 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:41:34,299 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:41:34,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:41:34,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,317 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split. New replication is 10
2013-10-31 18:41:34,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:34,325 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split. blk_5598164801874600176_1300
2013-10-31 18:41:34,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:51226 dest: /127.0.0.1:34578
2013-10-31 18:41:34,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:48315 dest: /127.0.0.1:37740
2013-10-31 18:41:34,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:44425 dest: /127.0.0.1:59471
2013-10-31 18:41:34,331 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5598164801874600176_1300 src: /127.0.0.1:48600 dest: /127.0.0.1:54365
2013-10-31 18:41:34,335 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48600, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5598164801874600176_1300, duration: 111187
2013-10-31 18:41:34,335 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,336 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44425, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 1059072
2013-10-31 18:41:34,336 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48315, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5598164801874600176_1300, duration: 2131796
2013-10-31 18:41:34,337 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,337 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,337 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51226, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 2926185
2013-10-31 18:41:34,338 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_5598164801874600176_1300 terminating
2013-10-31 18:41:34,343 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,343 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split from client DFSClient_-1596270109
2013-10-31 18:41:34,344 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split is closed by DFSClient_-1596270109
2013-10-31 18:41:34,344 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,345 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5598164801874600176_1300 size 2077
2013-10-31 18:41:34,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,377 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo. blk_-3493737347595243725_1301
2013-10-31 18:41:34,378 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:48601 dest: /127.0.0.1:54365
2013-10-31 18:41:34,380 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:48319 dest: /127.0.0.1:37740
2013-10-31 18:41:34,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3493737347595243725_1301 src: /127.0.0.1:44429 dest: /127.0.0.1:59471
2013-10-31 18:41:34,384 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44429, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3493737347595243725_1301, duration: 67413
2013-10-31 18:41:34,385 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48319, dest: /127.0.0.1:37740, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3493737347595243725_1301, duration: 864233
2013-10-31 18:41:34,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,386 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48601, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3493737347595243725_1301, duration: 1782963
2013-10-31 18:41:34,387 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3493737347595243725_1301 terminating
2013-10-31 18:41:34,388 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,390 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,390 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:41:34,391 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:41:34,391 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3493737347595243725_1301 size 218
2013-10-31 18:41:34,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,417 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml. blk_-8056076980841541999_1302
2013-10-31 18:41:34,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:48321 dest: /127.0.0.1:37740
2013-10-31 18:41:34,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:48605 dest: /127.0.0.1:54365
2013-10-31 18:41:34,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8056076980841541999_1302 src: /127.0.0.1:51235 dest: /127.0.0.1:34578
2013-10-31 18:41:34,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51235, dest: /127.0.0.1:34578, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8056076980841541999_1302, duration: 328818
2013-10-31 18:41:34,425 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,425 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48605, dest: /127.0.0.1:54365, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8056076980841541999_1302, duration: 1169381
2013-10-31 18:41:34,426 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,426 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48321, dest: /127.0.0.1:37740, bytes: 29470, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 2092939
2013-10-31 18:41:34,427 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8056076980841541999_1302 terminating
2013-10-31 18:41:34,428 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,429 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml from client DFSClient_-1596270109
2013-10-31 18:41:34,429 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:41:34,429 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8056076980841541999_1302 size 29470
2013-10-31 18:41:34,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=null
2013-10-31 18:41:34,449 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48325, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 465383
2013-10-31 18:41:34,467 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0030: nMaps=6 nReduces=1 max=-1
2013-10-31 18:41:34,468 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0030 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:41:34,468 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0030
2013-10-31 18:41:34,468 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0030 RESULT=SUCCESS
2013-10-31 18:41:34,468 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0030
2013-10-31 18:41:34,469 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper] submitted hadoop job: job_20131031182606197_0030
2013-10-31 18:41:34,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,497 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml. blk_5829088887948398201_1304
2013-10-31 18:41:34,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:48609 dest: /127.0.0.1:54365
2013-10-31 18:41:34,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:51239 dest: /127.0.0.1:34578
2013-10-31 18:41:34,502 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5829088887948398201_1304 src: /127.0.0.1:48328 dest: /127.0.0.1:37740
2013-10-31 18:41:34,506 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48328, dest: /127.0.0.1:37740, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5829088887948398201_1304, duration: 485642
2013-10-31 18:41:34,506 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,507 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51239, dest: /127.0.0.1:34578, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5829088887948398201_1304, duration: 1267326
2013-10-31 18:41:34,507 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,507 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,508 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48609, dest: /127.0.0.1:54365, bytes: 29535, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5829088887948398201_1304, duration: 2209178
2013-10-31 18:41:34,508 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5829088887948398201_1304 terminating
2013-10-31 18:41:34,510 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml from client DFSClient_-624635407
2013-10-31 18:41:34,511 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_conf.xml is closed by DFSClient_-624635407
2013-10-31 18:41:34,511 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,512 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5829088887948398201_1304 size 29535
2013-10-31 18:41:34,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:34,522 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken. blk_-2628080352316033489_1305
2013-10-31 18:41:34,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:48329 dest: /127.0.0.1:37740
2013-10-31 18:41:34,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:48613 dest: /127.0.0.1:54365
2013-10-31 18:41:34,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2628080352316033489_1305 src: /127.0.0.1:44440 dest: /127.0.0.1:59471
2013-10-31 18:41:34,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44440, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2628080352316033489_1305, duration: 1062166
2013-10-31 18:41:34,530 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48613, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 1690427
2013-10-31 18:41:34,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,531 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48329, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2628080352316033489_1305, duration: 2154121
2013-10-31 18:41:34,532 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2628080352316033489_1305 terminating
2013-10-31 18:41:34,533 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,534 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken from client DFSClient_-1596270109
2013-10-31 18:41:34,534 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:41:34,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,536 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2628080352316033489_1305 size 116
2013-10-31 18:41:34,544 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-3274370513633766733_1299 to datanode(s) 127.0.0.1:54365
2013-10-31 18:41:34,544 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1749832804603777904_1288 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1964692028297874732_1288 blk_1804964651075253424_1290 blk_8785549613552392148_1296
2013-10-31 18:41:34,545 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_-2443861200343278733_1291 blk_-1212781167072705890_1292 blk_1964692028297874732_1288 blk_1804964651075253424_1290 blk_243604678923041825_1293 blk_8785549613552392148_1296
2013-10-31 18:41:34,771 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken
2013-10-31 18:41:34,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.splitmetainfo dst=null perm=null
2013-10-31 18:41:34,775 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48615, bytes: 222, op: HDFS_READ, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3493737347595243725_1301, duration: 280578
2013-10-31 18:41:34,776 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0030 = 38. Number of splits = 6
2013-10-31 18:41:34,777 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,777 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,778 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,779 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,780 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0030_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:41:34,781 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0030 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:41:34,782 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0030 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:41:35,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data4/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:35,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data4/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:35,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data4/current/blk_-4446515941025710904
2013-10-31 18:41:35,211 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data3/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:35,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data4/current/blk_-2443861200343278733
2013-10-31 18:41:35,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data4/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:35,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data3/current/blk_-1212781167072705890
2013-10-31 18:41:35,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data4/current/blk_-566339595978537805
2013-10-31 18:41:35,212 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_243604678923041825_1293 file build/test/data/dfs/data/data4/current/blk_243604678923041825 for deletion
2013-10-31 18:41:35,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data3/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:35,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_243604678923041825_1293 at file build/test/data/dfs/data/data4/current/blk_243604678923041825
2013-10-31 18:41:35,213 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data3/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:35,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data3/current/blk_1804964651075253424
2013-10-31 18:41:35,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data3/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:35,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data3/current/blk_1964692028297874732
2013-10-31 18:41:35,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data4/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:35,214 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data3/current/blk_6468364575429809189
2013-10-31 18:41:35,215 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data4/current/blk_6893710486870095770
2013-10-31 18:41:35,215 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data3/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:35,215 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data3/current/blk_8785549613552392148
2013-10-31 18:41:35,456 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_800740813804517052_1298
2013-10-31 18:41:35,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data6/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:35,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2443861200343278733_1291 file build/test/data/dfs/data/data5/current/blk_-2443861200343278733 for deletion
2013-10-31 18:41:35,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data6/current/blk_-4446515941025710904
2013-10-31 18:41:35,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1212781167072705890_1292 file build/test/data/dfs/data/data6/current/blk_-1212781167072705890 for deletion
2013-10-31 18:41:35,940 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2443861200343278733_1291 at file build/test/data/dfs/data/data5/current/blk_-2443861200343278733
2013-10-31 18:41:35,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1212781167072705890_1292 at file build/test/data/dfs/data/data6/current/blk_-1212781167072705890
2013-10-31 18:41:35,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data5/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:35,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1804964651075253424_1290 file build/test/data/dfs/data/data6/current/blk_1804964651075253424 for deletion
2013-10-31 18:41:35,941 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data5/current/blk_1749832804603777904
2013-10-31 18:41:35,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data5/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:35,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1804964651075253424_1290 at file build/test/data/dfs/data/data6/current/blk_1804964651075253424
2013-10-31 18:41:35,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data6/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:35,942 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data5/current/blk_1964692028297874732
2013-10-31 18:41:35,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data6/current/blk_6468364575429809189
2013-10-31 18:41:35,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data6/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:35,943 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data6/current/blk_8785549613552392148
2013-10-31 18:41:36,337 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-3274370513633766733_1299 to 127.0.0.1:54365
2013-10-31 18:41:36,339 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3274370513633766733_1299 src: /127.0.0.1:48616 dest: /127.0.0.1:54365
2013-10-31 18:41:36,339 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-3274370513633766733_1299 to /127.0.0.1:54365
2013-10-31 18:41:36,343 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-3274370513633766733_1299 src: /127.0.0.1:48616 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:41:36,345 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3274370513633766733_1299 size 238055
2013-10-31 18:41:36,919 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0030_m_000007_0' to tip task_20131031182606197_0030_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:36,930 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:41:36,930 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000007_0 which needs 1 slots
2013-10-31 18:41:36,930 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000007_0 which needs 1 slots
2013-10-31 18:41:36,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken dst=null perm=null
2013-10-31 18:41:36,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48617, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 306931
2013-10-31 18:41:36,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=null
2013-10-31 18:41:36,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48336, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-547219168, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8056076980841541999_1302, duration: 431355
2013-10-31 18:41:36,979 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:37,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=null
2013-10-31 18:41:37,004 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44446, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-547219168, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3274370513633766733_1299, duration: 1232680
2013-10-31 18:41:37,098 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0029_m_1939526561
2013-10-31 18:41:37,104 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group754 with signal TERM. Exit code 0
2013-10-31 18:41:37,105 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:41:37,105 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_1591829464 spawned.
2013-10-31 18:41:37,107 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000007_0/taskjvm.sh
2013-10-31 18:41:37,373 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:37,373 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:37,373 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:37,374 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_1939526561 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:37,545 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1749832804603777904_1288 blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_-4446515941025710904_1288 blk_6468364575429809189_1285 blk_1964692028297874732_1288
2013-10-31 18:41:37,546 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_1749832804603777904_1288 blk_-566339595978537805_1283 blk_6893710486870095770_1289 blk_8785549613552392148_1296
2013-10-31 18:41:38,080 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:38,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:38,915 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,915 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0029_m_000004_0 not found in cache
2013-10-31 18:41:38,915 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,916 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298916
2013-10-31 18:41:38,916 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:38,917 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298917
2013-10-31 18:41:38,917 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331298917
2013-10-31 18:41:39,030 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0029
2013-10-31 18:41:39,031 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0029 for user-log deletion with retainTimeStamp:1383331299030
2013-10-31 18:41:39,153 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-1898251875 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,164 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group820 with signal TERM. Exit code 0
2013-10-31 18:41:39,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4446515941025710904_1288 file build/test/data/dfs/data/data1/current/blk_-4446515941025710904 for deletion
2013-10-31 18:41:39,337 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data1/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4446515941025710904_1288 at file build/test/data/dfs/data/data1/current/blk_-4446515941025710904
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data2/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data1/current/blk_-566339595978537805
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1964692028297874732_1288 file build/test/data/dfs/data/data2/current/blk_1964692028297874732 for deletion
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data2/current/blk_1749832804603777904
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6468364575429809189_1285 file build/test/data/dfs/data/data1/current/blk_6468364575429809189 for deletion
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1964692028297874732_1288 at file build/test/data/dfs/data/data2/current/blk_1964692028297874732
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data1/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6468364575429809189_1285 at file build/test/data/dfs/data/data1/current/blk_6468364575429809189
2013-10-31 18:41:39,338 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data1/current/blk_6893710486870095770
2013-10-31 18:41:39,393 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,393 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,393 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:39,394 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-1898251875 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:39,411 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-566339595978537805_1283 file build/test/data/dfs/data/data8/current/blk_-566339595978537805 for deletion
2013-10-31 18:41:39,411 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1749832804603777904_1288 file build/test/data/dfs/data/data7/current/blk_1749832804603777904 for deletion
2013-10-31 18:41:39,411 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-566339595978537805_1283 at file build/test/data/dfs/data/data8/current/blk_-566339595978537805
2013-10-31 18:41:39,411 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6893710486870095770_1289 file build/test/data/dfs/data/data8/current/blk_6893710486870095770 for deletion
2013-10-31 18:41:39,412 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1749832804603777904_1288 at file build/test/data/dfs/data/data7/current/blk_1749832804603777904
2013-10-31 18:41:39,412 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6893710486870095770_1289 at file build/test/data/dfs/data/data8/current/blk_6893710486870095770
2013-10-31 18:41:39,412 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8785549613552392148_1296 file build/test/data/dfs/data/data7/current/blk_8785549613552392148 for deletion
2013-10-31 18:41:39,413 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8785549613552392148_1296 at file build/test/data/dfs/data/data7/current/blk_8785549613552392148
2013-10-31 18:41:39,608 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-1471644336 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,617 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_-512352330 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,619 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group857 with signal TERM. Exit code 0
2013-10-31 18:41:39,626 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group858 with signal TERM. Exit code 0
2013-10-31 18:41:39,646 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_m_1993047584 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:39,653 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group588 with signal TERM. Exit code 0
2013-10-31 18:41:39,816 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,816 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,816 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:39,816 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_1993047584 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:41:39,835 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,835 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,835 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:39,835 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-1471644336 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:39,856 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:39,856 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:39,856 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:39,856 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_m_-512352330 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:40,411 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0029_r_1027368877 since job job_20131031182606197_0029 is dead
2013-10-31 18:41:40,423 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1033 with signal TERM. Exit code 0
2013-10-31 18:41:40,611 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:41:40,611 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:41:40,611 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:41:40,611 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0029_r_1027368877 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:41:41,526 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000007_0 0.0% setup
2013-10-31 18:41:41,528 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000007_0 is done.
2013-10-31 18:41:41,529 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000007_0 was -1
2013-10-31 18:41:41,529 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:42,936 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000007_0' has completed task_20131031182606197_0030_m_000007 successfully.
2013-10-31 18:41:42,940 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000000_0' to tip task_20131031182606197_0030_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:42,941 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000000
2013-10-31 18:41:42,941 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000001_0' to tip task_20131031182606197_0030_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:42,942 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000001
2013-10-31 18:41:42,944 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000002_0' to tip task_20131031182606197_0030_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:42,945 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:42,945 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000002
2013-10-31 18:41:42,946 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:41:42,946 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000003_0' to tip task_20131031182606197_0030_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:41:42,946 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000000_0 which needs 1 slots
2013-10-31 18:41:42,947 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000000_0 which needs 1 slots
2013-10-31 18:41:42,947 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000003
2013-10-31 18:41:42,947 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000001_0 which needs 1 slots
2013-10-31 18:41:42,948 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000001_0 which needs 1 slots
2013-10-31 18:41:42,952 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:41:42,954 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:41:42,955 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000002_0 which needs 1 slots
2013-10-31 18:41:42,955 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000002_0 which needs 1 slots
2013-10-31 18:41:42,955 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000003_0 which needs 1 slots
2013-10-31 18:41:42,956 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000003_0 which needs 1 slots
2013-10-31 18:41:42,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken dst=null perm=null
2013-10-31 18:41:42,964 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48340, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2628080352316033489_1305, duration: 293202
2013-10-31 18:41:42,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=null
2013-10-31 18:41:42,976 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000004_0' to tip task_20131031182606197_0030_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:42,976 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48625, bytes: 29702, op: HDFS_READ, cliID: DFSClient_35762182, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8056076980841541999_1302, duration: 567113
2013-10-31 18:41:42,977 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000004
2013-10-31 18:41:42,977 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0030_m_000005_0' to tip task_20131031182606197_0030_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:41:42,978 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0030_m_000005
2013-10-31 18:41:42,980 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:41:42,981 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:41:42,982 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000004_0 which needs 1 slots
2013-10-31 18:41:42,982 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000004_0 which needs 1 slots
2013-10-31 18:41:42,982 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000005_0 which needs 1 slots
2013-10-31 18:41:42,983 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0030_m_000005_0 which needs 1 slots
2013-10-31 18:41:42,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030/jobToken dst=null perm=null
2013-10-31 18:41:42,992 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48626, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2628080352316033489_1305, duration: 266111
2013-10-31 18:41:42,993 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_-230758348
2013-10-31 18:41:42,994 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_-230758348 spawned.
2013-10-31 18:41:42,996 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0030/attempt_20131031182606197_0030_m_000001_0. Attempting to reuse: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:41:42,998 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000000_0/taskjvm.sh
2013-10-31 18:41:43,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.xml dst=null perm=null
2013-10-31 18:41:43,004 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51257, bytes: 29702, op: HDFS_READ, cliID: DFSClient_-319392861, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8056076980841541999_1302, duration: 181494
2013-10-31 18:41:43,033 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:43,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=null
2013-10-31 18:41:43,062 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51258, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-319392861, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3274370513633766733_1299, duration: 1232161
2013-10-31 18:41:43,076 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:41:43,084 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000001_0
2013-10-31 18:41:43,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.jar dst=null perm=null
2013-10-31 18:41:43,103 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48347, bytes: 239915, op: HDFS_READ, cliID: DFSClient_35762182, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3274370513633766733_1299, duration: 1285929
2013-10-31 18:41:43,139 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_585283222
2013-10-31 18:41:43,140 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_585283222 spawned.
2013-10-31 18:41:43,140 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_-1072137497
2013-10-31 18:41:43,141 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_-1072137497 spawned.
2013-10-31 18:41:43,142 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000005_0/taskjvm.sh
2013-10-31 18:41:43,142 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000004_0/taskjvm.sh
2013-10-31 18:41:43,164 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_237536229
2013-10-31 18:41:43,164 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_237536229 spawned.
2013-10-31 18:41:43,164 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_m_926338037
2013-10-31 18:41:43,166 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_m_926338037 spawned.
2013-10-31 18:41:43,166 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000003_0/taskjvm.sh
2013-10-31 18:41:43,167 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_m_000002_0/taskjvm.sh
2013-10-31 18:41:43,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:43,783 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44460, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 375429
2013-10-31 18:41:43,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:41:43,823 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51264, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 109853
2013-10-31 18:41:44,245 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_-230758348 given task: attempt_20131031182606197_0030_m_000000_0
2013-10-31 18:41:44,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:44,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51266, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 170875
2013-10-31 18:41:44,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:41:45,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48359, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 141420
2013-10-31 18:41:45,225 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_-1072137497 given task: attempt_20131031182606197_0030_m_000004_0
2013-10-31 18:41:45,239 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_585283222 given task: attempt_20131031182606197_0030_m_000005_0
2013-10-31 18:41:45,259 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_926338037 given task: attempt_20131031182606197_0030_m_000002_0
2013-10-31 18:41:45,266 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_237536229 given task: attempt_20131031182606197_0030_m_000003_0
2013-10-31 18:41:45,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:45,745 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44473, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000004_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 173604
2013-10-31 18:41:45,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:45,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:45,769 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44474, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000002_0, offset: 512, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5598164801874600176_1300, duration: 160880
2013-10-31 18:41:45,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51278, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000005_0, offset: 1536, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5598164801874600176_1300, duration: 156962
2013-10-31 18:41:45,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030/job.split dst=null perm=null
2013-10-31 18:41:45,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:41:45,791 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51279, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000004_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3135295757712174631_1031, duration: 172000
2013-10-31 18:41:45,794 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48368, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5598164801874600176_1300, duration: 158884
2013-10-31 18:41:45,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:41:45,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:41:45,813 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48652, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000005_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 118785
2013-10-31 18:41:45,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:41:45,835 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48653, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 134733
2013-10-31 18:41:46,060 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44480, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0030_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 138649
2013-10-31 18:41:46,745 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:41:46,748 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000001_0 is done.
2013-10-31 18:41:46,748 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000001_0 was 40
2013-10-31 18:41:46,748 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:47,759 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:41:47,762 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000000_0 is done.
2013-10-31 18:41:47,762 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000000_0 was 57
2013-10-31 18:41:47,763 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:47,947 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:47,947 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0030_m_000007_0
2013-10-31 18:41:47,947 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0030_m_000007_0 not found in cache
2013-10-31 18:41:48,670 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:41:48,672 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000004_0 is done.
2013-10-31 18:41:48,673 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000004_0 was 6
2013-10-31 18:41:48,673 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:48,688 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:41:48,690 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000005_0 is done.
2013-10-31 18:41:48,690 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000005_0 was 6
2013-10-31 18:41:48,690 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:48,693 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:41:48,694 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000002_0 is done.
2013-10-31 18:41:48,695 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000002_0 was 57
2013-10-31 18:41:48,695 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:41:48,721 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:41:48,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000003_0 is done.
2013-10-31 18:41:48,722 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000003_0 was 40
2013-10-31 18:41:48,723 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:41:48,950 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000000_0' has completed task_20131031182606197_0030_m_000000 successfully.
2013-10-31 18:41:48,952 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000001_0' has completed task_20131031182606197_0030_m_000001 successfully.
2013-10-31 18:41:48,954 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0030_r_000000_0' to tip task_20131031182606197_0030_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:41:48,956 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:41:48,956 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_r_000000_0 which needs 1 slots
2013-10-31 18:41:48,956 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000002_0' has completed task_20131031182606197_0030_m_000002 successfully.
2013-10-31 18:41:48,957 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_r_000000_0 which needs 1 slots
2013-10-31 18:41:48,958 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000003_0' has completed task_20131031182606197_0030_m_000003 successfully.
2013-10-31 18:41:48,984 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000004_0' has completed task_20131031182606197_0030_m_000004 successfully.
2013-10-31 18:41:48,985 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000005_0' has completed task_20131031182606197_0030_m_000005 successfully.
2013-10-31 18:41:48,992 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0030_r_-2128071556
2013-10-31 18:41:48,993 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0030_r_-2128071556 spawned.
2013-10-31 18:41:48,994 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0030/attempt_20131031182606197_0030_r_000000_0/taskjvm.sh
2013-10-31 18:41:50,130 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_r_-2128071556 given task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:55,825 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42689, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000000_0, duration: 8655027
2013-10-31 18:41:55,843 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42689, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000001_0, duration: 10482318
2013-10-31 18:41:55,860 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50324, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000002_0, duration: 11894283
2013-10-31 18:41:55,875 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50324, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000003_0, duration: 11502776
2013-10-31 18:41:55,892 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45367, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000004_0, duration: 11793621
2013-10-31 18:41:55,907 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45367, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0030_m_000005_0, duration: 11290458
2013-10-31 18:41:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:41:56,015 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,020 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,031 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,036 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:41:56,041 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:41:56,623 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,699 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,780 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:56,986 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1600 Total time for transactions(ms): 32Number of transactions batched in Syncs: 134 Number of syncs: 1120 SyncTimes(ms): 72542 16302
2013-10-31 18:41:56,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:57,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:57,028 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000. blk_-1943840392902481091_1306
2013-10-31 18:41:57,063 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:48378 dest: /127.0.0.1:37740
2013-10-31 18:41:57,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:48662 dest: /127.0.0.1:54365
2013-10-31 18:41:57,066 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1943840392902481091_1306 src: /127.0.0.1:51292 dest: /127.0.0.1:34578
2013-10-31 18:41:57,070 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51292, dest: /127.0.0.1:34578, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1943840392902481091_1306, duration: 1492839
2013-10-31 18:41:57,071 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,071 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48662, dest: /127.0.0.1:54365, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1943840392902481091_1306, duration: 3261206
2013-10-31 18:41:57,072 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,072 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48378, dest: /127.0.0.1:37740, bytes: 20, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0030_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 5038260
2013-10-31 18:41:57,073 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1943840392902481091_1306 terminating
2013-10-31 18:41:57,073 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,075 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:57,076 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:57,076 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1943840392902481091_1306 size 20
2013-10-31 18:41:57,111 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0030_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:41:57,111 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:41:57,966 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031182606197_0030_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:41:57,967 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:41:58,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0 dst=null perm=null
2013-10-31 18:41:58,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:41:58,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:41:58,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary/_attempt_20131031182606197_0030_r_000000_0 dst=null perm=null
2013-10-31 18:41:59,672 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:59,675 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_r_000000_0 1.0% reduce > reduce
2013-10-31 18:41:59,676 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_r_000000_0 is done.
2013-10-31 18:41:59,676 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_r_000000_0 was -1
2013-10-31 18:41:59,676 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:00,970 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_r_000000_0' has completed task_20131031182606197_0030_r_000000 successfully.
2013-10-31 18:42:00,987 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0030_m_000006_0' to tip task_20131031182606197_0030_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:00,990 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0030_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:42:00,991 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0030_m_000006_0 which needs 1 slots
2013-10-31 18:42:00,991 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0030_m_000006_0 which needs 1 slots
2013-10-31 18:42:01,030 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0030/attempt_20131031182606197_0030_m_000006_0. Attempting to reuse: jvm_20131031182606197_0030_m_1591829464
2013-10-31 18:42:02,294 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0030_m_1591829464 given task: attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,424 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000006_0 0.0%
2013-10-31 18:42:02,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary dst=null perm=null
2013-10-31 18:42:02,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:02,443 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS from client DFSClient_attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,444 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0030_m_000006_0
2013-10-31 18:42:02,448 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3274370513633766733 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5598164801874600176 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3493737347595243725 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:02,449 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:02,450 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8056076980841541999 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:02,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0030 dst=null perm=null
2013-10-31 18:42:04,550 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-3274370513633766733_1299 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:04,550 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:05,398 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0030_m_000006_0 0.0% cleanup
2013-10-31 18:42:05,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0030_m_000006_0 is done.
2013-10-31 18:42:05,399 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0030_m_000006_0 was -1
2013-10-31 18:42:05,400 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:05,991 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:42:05,991 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0030_r_000000_0
2013-10-31 18:42:06,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data2/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:06,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data2/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:06,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data2/current/blk_-8056076980841541999
2013-10-31 18:42:06,347 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data1/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:06,348 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data2/current/blk_-3274370513633766733
2013-10-31 18:42:06,348 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data1/current/blk_5598164801874600176
2013-10-31 18:42:06,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data7/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:06,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data8/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:06,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data7/current/blk_-8056076980841541999
2013-10-31 18:42:06,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data8/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:06,420 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data8/current/blk_-3493737347595243725
2013-10-31 18:42:06,421 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data7/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:06,421 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data8/current/blk_-3274370513633766733
2013-10-31 18:42:06,421 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data7/current/blk_5598164801874600176
2013-10-31 18:42:06,998 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0030_m_000006_0' has completed task_20131031182606197_0030_m_000006 successfully.
2013-10-31 18:42:06,999 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0030 has completed successfully.
2013-10-31 18:42:06,999 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0030,submitTime=1383244894435,launchTime=1383244894781,firstMapTaskLaunchTime=1383244902940,firstReduceTaskLaunchTime=1383244908953,firstJobSetupTaskLaunchTime=1383244896919,firstJobCleanupTaskLaunchTime=1383244920987,finishTime=1383244926999,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[7EE435642A834BB9AD13D3AF2B9F9FA1/9123A166C26B48BF9A23CF9D5EF2DE87] lower+upper/(1/1) ...grouping-nondeterministic
2013-10-31 18:42:07,004 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF. blk_5752235491390791018_1307
2013-10-31 18:42:07,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:44492 dest: /127.0.0.1:59471
2013-10-31 18:42:07,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:48667 dest: /127.0.0.1:54365
2013-10-31 18:42:07,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5752235491390791018_1307 src: /127.0.0.1:48385 dest: /127.0.0.1:37740
2013-10-31 18:42:07,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48385, dest: /127.0.0.1:37740, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5752235491390791018_1307, duration: 2360591
2013-10-31 18:42:07,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48667, dest: /127.0.0.1:54365, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5752235491390791018_1307, duration: 3629289
2013-10-31 18:42:07,017 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44492, dest: /127.0.0.1:59471, bytes: 34976, op: HDFS_WRITE, cliID: DFSClient_-624635407, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5752235491390791018_1307, duration: 4458269
2013-10-31 18:42:07,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5752235491390791018_1307 terminating
2013-10-31 18:42:07,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,022 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF from client DFSClient_-624635407
2013-10-31 18:42:07,023 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_logs/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF is closed by DFSClient_-624635407
2013-10-31 18:42:07,023 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5752235491390791018_1307 size 34976
2013-10-31 18:42:07,031 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0030_1383244894435_hadoop_%5B7EE435642A834BB9AD13D3AF2B9F9FA1%2F9123A166C26B48BF to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:07,032 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000000_0'
2013-10-31 18:42:07,032 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000001_0'
2013-10-31 18:42:07,032 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000006_0'
2013-10-31 18:42:07,032 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000007_0'
2013-10-31 18:42:07,033 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:07,033 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_r_000000_0'
2013-10-31 18:42:07,034 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:07,034 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2628080352316033489 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:07,035 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000002_0'
2013-10-31 18:42:07,035 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000003_0'
2013-10-31 18:42:07,035 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000004_0'
2013-10-31 18:42:07,036 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0030_m_000005_0'
2013-10-31 18:42:07,041 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/_temporary
2013-10-31 18:42:07,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic dst=null perm=null
2013-10-31 18:42:07,061 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:07,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000 dst=null perm=null
2013-10-31 18:42:07,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000 dst=null perm=null
2013-10-31 18:42:07,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48387, bytes: 24, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 277421
2013-10-31 18:42:07,067 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic
2013-10-31 18:42:07,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic dst=null perm=null
2013-10-31 18:42:07,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/insensitivegrouping-nondeterministic/part-00000 dst=null perm=null
2013-10-31 18:42:07,099 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:07,099 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0030 being deleted.
2013-10-31 18:42:07,551 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-2628080352316033489_1305 blk_5598164801874600176_1300
2013-10-31 18:42:07,551 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3493737347595243725_1301 blk_-3274370513633766733_1299 blk_-2628080352316033489_1305 blk_-8056076980841541999_1302 blk_5598164801874600176_1300
2013-10-31 18:42:07,615 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48388, bytes: 24, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1943840392902481091_1306, duration: 351356
2013-10-31 18:42:07,632 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:42:07,632 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:42:07,641 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:42:07,641 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt"]
2013-10-31 18:42:07,642 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon"]
2013-10-31 18:42:07,642 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:42:07,642 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:42:07,643 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:42:07,643 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...pesplatform/ungroupedanon
2013-10-31 18:42:07,646 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:42:07,646 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:42:08,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8056076980841541999_1302 file build/test/data/dfs/data/data4/current/blk_-8056076980841541999 for deletion
2013-10-31 18:42:08,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data3/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:08,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8056076980841541999_1302 at file build/test/data/dfs/data/data4/current/blk_-8056076980841541999
2013-10-31 18:42:08,222 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data3/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:08,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data3/current/blk_-3493737347595243725
2013-10-31 18:42:08,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data4/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:08,223 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data4/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:08,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data4/current/blk_-2628080352316033489
2013-10-31 18:42:08,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data4/current/blk_5598164801874600176
2013-10-31 18:42:08,454 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data3/current/blk_-3274370513633766733
2013-10-31 18:42:08,457 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0030_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:08,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0030 dst=null perm=null
2013-10-31 18:42:08,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:08,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:42:08,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,520 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar. blk_3405378349805446451_1308
2013-10-31 18:42:08,522 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:48672 dest: /127.0.0.1:54365
2013-10-31 18:42:08,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:51302 dest: /127.0.0.1:34578
2013-10-31 18:42:08,526 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:44500 dest: /127.0.0.1:59471
2013-10-31 18:42:08,536 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44500, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3405378349805446451_1308, duration: 6629327
2013-10-31 18:42:08,536 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,537 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51302, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3405378349805446451_1308, duration: 7439483
2013-10-31 18:42:08,538 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,538 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48672, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3405378349805446451_1308, duration: 8657758
2013-10-31 18:42:08,539 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3405378349805446451_1308 terminating
2013-10-31 18:42:08,540 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,541 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar from client DFSClient_-1596270109
2013-10-31 18:42:08,541 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:42:08,542 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,542 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:08,547 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar. New replication is 10
2013-10-31 18:42:08,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=null
2013-10-31 18:42:08,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,938 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:42:08,942 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:08,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:08,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,951 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3493737347595243725_1301 file build/test/data/dfs/data/data6/current/blk_-3493737347595243725 for deletion
2013-10-31 18:42:08,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3274370513633766733_1299 file build/test/data/dfs/data/data6/current/blk_-3274370513633766733 for deletion
2013-10-31 18:42:08,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3493737347595243725_1301 at file build/test/data/dfs/data/data6/current/blk_-3493737347595243725
2013-10-31 18:42:08,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data5/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:08,952 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3274370513633766733_1299 at file build/test/data/dfs/data/data6/current/blk_-3274370513633766733
2013-10-31 18:42:08,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data5/current/blk_-2628080352316033489
2013-10-31 18:42:08,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5598164801874600176_1300 file build/test/data/dfs/data/data5/current/blk_5598164801874600176 for deletion
2013-10-31 18:42:08,953 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5598164801874600176_1300 at file build/test/data/dfs/data/data5/current/blk_5598164801874600176
2013-10-31 18:42:08,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,956 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split. New replication is 10
2013-10-31 18:42:08,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:08,963 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split. blk_-3576267029470916644_1309
2013-10-31 18:42:08,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:48392 dest: /127.0.0.1:37740
2013-10-31 18:42:08,966 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:51305 dest: /127.0.0.1:34578
2013-10-31 18:42:08,968 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:48677 dest: /127.0.0.1:54365
2013-10-31 18:42:08,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3576267029470916644_1309 src: /127.0.0.1:44504 dest: /127.0.0.1:59471
2013-10-31 18:42:08,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44504, dest: /127.0.0.1:59471, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3576267029470916644_1309, duration: 88363
2013-10-31 18:42:08,973 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48677, dest: /127.0.0.1:54365, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 907013
2013-10-31 18:42:08,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51305, dest: /127.0.0.1:34578, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3576267029470916644_1309, duration: 1705510
2013-10-31 18:42:08,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,975 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,975 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48392, dest: /127.0.0.1:37740, bytes: 1762, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3576267029470916644_1309, duration: 2661925
2013-10-31 18:42:08,976 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3576267029470916644_1309 terminating
2013-10-31 18:42:08,979 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,979 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split from client DFSClient_-1596270109
2013-10-31 18:42:08,980 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split is closed by DFSClient_-1596270109
2013-10-31 18:42:08,980 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3576267029470916644_1309 size 1762
2013-10-31 18:42:08,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:08,999 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo. blk_2501650952349019281_1310
2013-10-31 18:42:09,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:51308 dest: /127.0.0.1:34578
2013-10-31 18:42:09,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:44506 dest: /127.0.0.1:59471
2013-10-31 18:42:09,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2501650952349019281_1310 src: /127.0.0.1:48681 dest: /127.0.0.1:54365
2013-10-31 18:42:09,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48681, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_2501650952349019281_1310, duration: 66043
2013-10-31 18:42:09,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44506, dest: /127.0.0.1:59471, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2501650952349019281_1310, duration: 866783
2013-10-31 18:42:09,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51308, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2501650952349019281_1310, duration: 1933341
2013-10-31 18:42:09,010 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2501650952349019281_1310 terminating
2013-10-31 18:42:09,010 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,013 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:42:09,013 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:42:09,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,014 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2501650952349019281_1310 size 183
2013-10-31 18:42:09,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,036 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml. blk_602449860203028534_1311
2013-10-31 18:42:09,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:48682 dest: /127.0.0.1:54365
2013-10-31 18:42:09,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:51312 dest: /127.0.0.1:34578
2013-10-31 18:42:09,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_602449860203028534_1311 src: /127.0.0.1:48401 dest: /127.0.0.1:37740
2013-10-31 18:42:09,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48401, dest: /127.0.0.1:37740, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_602449860203028534_1311, duration: 288169
2013-10-31 18:42:09,044 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51312, dest: /127.0.0.1:34578, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 1108611
2013-10-31 18:42:09,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,045 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,046 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48682, dest: /127.0.0.1:54365, bytes: 27576, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_602449860203028534_1311, duration: 2015783
2013-10-31 18:42:09,046 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,046 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_602449860203028534_1311 terminating
2013-10-31 18:42:09,051 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_602449860203028534_1311 size 27576
2013-10-31 18:42:09,052 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml from client DFSClient_-1596270109
2013-10-31 18:42:09,052 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:42:09,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=null
2013-10-31 18:42:09,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51315, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 454103
2013-10-31 18:42:09,085 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0031: nMaps=5 nReduces=0 max=-1
2013-10-31 18:42:09,085 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0031 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:42:09,086 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0031
2013-10-31 18:42:09,086 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0031 RESULT=SUCCESS
2013-10-31 18:42:09,086 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0031
2013-10-31 18:42:09,087 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0031
2013-10-31 18:42:09,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,121 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml. blk_-7567248241593720369_1313
2013-10-31 18:42:09,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:44513 dest: /127.0.0.1:59471
2013-10-31 18:42:09,124 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:48405 dest: /127.0.0.1:37740
2013-10-31 18:42:09,126 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7567248241593720369_1313 src: /127.0.0.1:51318 dest: /127.0.0.1:34578
2013-10-31 18:42:09,130 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51318, dest: /127.0.0.1:34578, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7567248241593720369_1313, duration: 1097875
2013-10-31 18:42:09,131 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,131 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48405, dest: /127.0.0.1:37740, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7567248241593720369_1313, duration: 2075935
2013-10-31 18:42:09,132 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,132 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44513, dest: /127.0.0.1:59471, bytes: 27641, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7567248241593720369_1313, duration: 2830701
2013-10-31 18:42:09,133 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7567248241593720369_1313 terminating
2013-10-31 18:42:09,133 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,135 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml from client DFSClient_-1193761217
2013-10-31 18:42:09,135 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_conf.xml is closed by DFSClient_-1193761217
2013-10-31 18:42:09,136 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,136 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7567248241593720369_1313 size 27641
2013-10-31 18:42:09,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:09,154 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken. blk_4951964880204109736_1314
2013-10-31 18:42:09,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:51319 dest: /127.0.0.1:34578
2013-10-31 18:42:09,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:44517 dest: /127.0.0.1:59471
2013-10-31 18:42:09,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4951964880204109736_1314 src: /127.0.0.1:48692 dest: /127.0.0.1:54365
2013-10-31 18:42:09,161 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4951964880204109736_1314, duration: 1013877
2013-10-31 18:42:09,162 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,162 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44517, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 937472
2013-10-31 18:42:09,163 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,163 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51319, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4951964880204109736_1314, duration: 2083688
2013-10-31 18:42:09,164 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4951964880204109736_1314 terminating
2013-10-31 18:42:09,166 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,167 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,167 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4951964880204109736_1314 size 116
2013-10-31 18:42:09,566 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken from client DFSClient_-1596270109
2013-10-31 18:42:09,567 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:42:09,946 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken
2013-10-31 18:42:09,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.splitmetainfo dst=null perm=null
2013-10-31 18:42:09,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51322, bytes: 187, op: HDFS_READ, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2501650952349019281_1310, duration: 359306
2013-10-31 18:42:09,952 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0031 = 30. Number of splits = 5
2013-10-31 18:42:09,952 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,953 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,954 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,955 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0031_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:09,956 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0031 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:42:09,957 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0031 initialized successfully with 5 map tasks and 0 reduce tasks.
2013-10-31 18:42:10,038 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0031_m_000006_0' to tip task_20131031182606197_0031_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:10,046 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:42:10,047 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000006_0 which needs 1 slots
2013-10-31 18:42:10,047 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000006_0 which needs 1 slots
2013-10-31 18:42:10,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken dst=null perm=null
2013-10-31 18:42:10,055 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44520, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 289758
2013-10-31 18:42:10,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=null
2013-10-31 18:42:10,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51325, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1371319316, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_602449860203028534_1311, duration: 376769
2013-10-31 18:42:10,095 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:10,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=null
2013-10-31 18:42:10,124 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44523, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1371319316, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3405378349805446451_1308, duration: 1184457
2013-10-31 18:42:10,217 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0030_m_-230758348
2013-10-31 18:42:10,221 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1424 with signal TERM. Exit code 0
2013-10-31 18:42:10,222 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:10,227 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1888122456 spawned.
2013-10-31 18:42:10,228 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000006_0/taskjvm.sh
2013-10-31 18:42:10,552 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_3405378349805446451_1308 to datanode(s) 127.0.0.1:37740
2013-10-31 18:42:10,553 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-2628080352316033489_1305
2013-10-31 18:42:10,673 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:10,673 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:10,673 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:10,673 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_-230758348 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:11,223 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_3405378349805446451_1308 to 127.0.0.1:37740
2013-10-31 18:42:11,224 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_3405378349805446451_1308 to /127.0.0.1:37740
2013-10-31 18:42:11,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3405378349805446451_1308 src: /127.0.0.1:48415 dest: /127.0.0.1:37740
2013-10-31 18:42:11,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3405378349805446451_1308 src: /127.0.0.1:48415 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:42:11,233 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3405378349805446451_1308 size 238055
2013-10-31 18:42:11,439 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1888122456 given task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:11,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:12,035 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,035 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0030_m_000006_0 not found in cache
2013-10-31 18:42:12,036 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,036 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332036
2013-10-31 18:42:12,037 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332037
2013-10-31 18:42:12,060 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0030
2013-10-31 18:42:12,060 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0030 for user-log deletion with retainTimeStamp:1383331332060
2013-10-31 18:42:12,301 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_r_-2128071556 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:12,312 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1755 with signal TERM. Exit code 0
2013-10-31 18:42:12,421 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2628080352316033489_1305 file build/test/data/dfs/data/data7/current/blk_-2628080352316033489 for deletion
2013-10-31 18:42:12,422 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2628080352316033489_1305 at file build/test/data/dfs/data/data7/current/blk_-2628080352316033489
2013-10-31 18:42:12,492 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:12,492 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:12,493 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:12,493 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_r_-2128071556 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,246 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_-1072137497 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,254 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1488 with signal TERM. Exit code 0
2013-10-31 18:42:13,254 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_585283222 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,257 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_926338037 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,265 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1483 with signal TERM. Exit code 0
2013-10-31 18:42:13,267 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1489 with signal TERM. Exit code 0
2013-10-31 18:42:13,290 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_237536229 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,295 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1490 with signal TERM. Exit code 0
2013-10-31 18:42:13,465 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,465 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,465 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:13,465 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_-1072137497 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,481 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,482 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,482 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:13,482 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_926338037 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,490 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,490 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,490 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:13,490 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_585283222 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,498 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,498 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,498 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:13,498 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_237536229 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:13,506 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0030_m_1591829464 since job job_20131031182606197_0030 is dead
2013-10-31 18:42:13,510 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1248 with signal TERM. Exit code 0
2013-10-31 18:42:13,684 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:13,684 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:13,684 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:13,685 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0030_m_1591829464 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:42:14,890 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000006_0 0.0% setup
2013-10-31 18:42:14,893 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000006_0 is done.
2013-10-31 18:42:14,893 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000006_0 was -1
2013-10-31 18:42:14,894 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:16,053 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000006_0' has completed task_20131031182606197_0031_m_000006 successfully.
2013-10-31 18:42:16,056 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000000_0' to tip task_20131031182606197_0031_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:16,057 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000000
2013-10-31 18:42:16,058 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000001_0' to tip task_20131031182606197_0031_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:16,058 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000001
2013-10-31 18:42:16,060 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000002_0' to tip task_20131031182606197_0031_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:16,061 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:16,061 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000002
2013-10-31 18:42:16,062 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:42:16,063 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000003_0' to tip task_20131031182606197_0031_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:16,063 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000000_0 which needs 1 slots
2013-10-31 18:42:16,063 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000000_0 which needs 1 slots
2013-10-31 18:42:16,063 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000003
2013-10-31 18:42:16,064 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000001_0 which needs 1 slots
2013-10-31 18:42:16,064 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0031_m_000001_0 which needs 1 slots
2013-10-31 18:42:16,070 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:42:16,072 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:42:16,072 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000002_0 which needs 1 slots
2013-10-31 18:42:16,072 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000002_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000003_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0031_m_000003_0 which needs 1 slots
2013-10-31 18:42:16,073 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0031_m_000004_0' to tip task_20131031182606197_0031_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:42:16,074 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0031_m_000004
2013-10-31 18:42:16,077 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:42:16,077 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000004_0 which needs 1 slots
2013-10-31 18:42:16,078 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000004_0 which needs 1 slots
2013-10-31 18:42:16,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken dst=null perm=null
2013-10-31 18:42:16,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031/jobToken dst=null perm=null
2013-10-31 18:42:16,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51331, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4951964880204109736_1314, duration: 482609
2013-10-31 18:42:16,086 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44529, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4951964880204109736_1314, duration: 314541
2013-10-31 18:42:16,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=null
2013-10-31 18:42:16,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.xml dst=null perm=null
2013-10-31 18:42:16,095 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48423, bytes: 27792, op: HDFS_READ, cliID: DFSClient_-1093947786, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_602449860203028534_1311, duration: 416379
2013-10-31 18:42:16,096 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48707, bytes: 27792, op: HDFS_READ, cliID: DFSClient_1247866216, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_602449860203028534_1311, duration: 162017
2013-10-31 18:42:16,100 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_-1600883262
2013-10-31 18:42:16,101 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_-1600883262 spawned.
2013-10-31 18:42:16,101 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0031/attempt_20131031182606197_0031_m_000000_0. Attempting to reuse: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:16,102 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000001_0/taskjvm.sh
2013-10-31 18:42:16,446 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1888122456 given task: attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:16,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:16,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44535, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3576267029470916644_1309, duration: 168282
2013-10-31 18:42:16,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:17,686 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:17,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=null
2013-10-31 18:42:17,718 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48427, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1093947786, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3405378349805446451_1308, duration: 1151717
2013-10-31 18:42:17,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:17,772 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:17,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.jar dst=null perm=null
2013-10-31 18:42:17,813 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48711, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1247866216, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3405378349805446451_1308, duration: 1202694
2013-10-31 18:42:17,935 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1711463638
2013-10-31 18:42:17,937 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1711463638 spawned.
2013-10-31 18:42:17,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:17,937 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_-1236212079
2013-10-31 18:42:17,940 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_-1236212079 spawned.
2013-10-31 18:42:17,942 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000002_0/taskjvm.sh
2013-10-31 18:42:17,943 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000003_0/taskjvm.sh
2013-10-31 18:42:17,986 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0031_m_1917937103
2013-10-31 18:42:17,987 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0031_m_1917937103 spawned.
2013-10-31 18:42:17,988 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0031/attempt_20131031182606197_0031_m_000004_0/taskjvm.sh
2013-10-31 18:42:18,741 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1600883262 given task: attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:18,926 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48430, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 139442
2013-10-31 18:42:18,931 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000. blk_1487922476689862061_1315
2013-10-31 18:42:18,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:44540 dest: /127.0.0.1:59471
2013-10-31 18:42:18,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:48432 dest: /127.0.0.1:37740
2013-10-31 18:42:18,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1487922476689862061_1315 src: /127.0.0.1:48716 dest: /127.0.0.1:54365
2013-10-31 18:42:18,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48716, dest: /127.0.0.1:54365, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1487922476689862061_1315, duration: 21664812
2013-10-31 18:42:18,973 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,973 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48432, dest: /127.0.0.1:37740, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1487922476689862061_1315, duration: 22031827
2013-10-31 18:42:18,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44540, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1487922476689862061_1315, duration: 22537309
2013-10-31 18:42:18,974 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1487922476689862061_1315 terminating
2013-10-31 18:42:18,974 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:18,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:18,978 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:18,978 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:18,978 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1487922476689862061_1315 size 16
2013-10-31 18:42:19,020 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:19,020 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 0.0%
2013-10-31 18:42:19,062 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000000_0
2013-10-31 18:42:19,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:19,273 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48718, bytes: 1778, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 174615
2013-10-31 18:42:19,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:19,313 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48719, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-677913094566701302_1219, duration: 129084
2013-10-31 18:42:19,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:19,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:19,504 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001. blk_-3429000233400764538_1316
2013-10-31 18:42:19,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:48723 dest: /127.0.0.1:54365
2013-10-31 18:42:19,529 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:48441 dest: /127.0.0.1:37740
2013-10-31 18:42:19,530 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3429000233400764538_1316 src: /127.0.0.1:51354 dest: /127.0.0.1:34578
2013-10-31 18:42:19,532 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51354, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 1230654
2013-10-31 18:42:19,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,533 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48441, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3429000233400764538_1316, duration: 1567897
2013-10-31 18:42:19,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,533 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48723, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3429000233400764538_1316, duration: 1926770
2013-10-31 18:42:19,533 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3429000233400764538_1316 terminating
2013-10-31 18:42:19,534 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,534 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:19,535 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:19,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,537 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3429000233400764538_1316 size 8
2013-10-31 18:42:19,583 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:19,583 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 0.0%
2013-10-31 18:42:19,621 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1711463638 given task: attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:19,672 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1236212079 given task: attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:19,678 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_1917937103 given task: attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0 dst=null perm=null
2013-10-31 18:42:20,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000000_0 dst=null perm=null
2013-10-31 18:42:20,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:20,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51358, bytes: 1262, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3576267029470916644_1309, duration: 162711
2013-10-31 18:42:20,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:20,174 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48730, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 141137
2013-10-31 18:42:20,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031/job.split dst=null perm=null
2013-10-31 18:42:20,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:20,185 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48731, bytes: 746, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3576267029470916644_1309, duration: 143748
2013-10-31 18:42:20,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48449, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 101412
2013-10-31 18:42:20,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:20,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48450, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 107424
2013-10-31 18:42:20,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt dst=null perm=null
2013-10-31 18:42:20,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,225 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48451, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0031_m_000004_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-677913094566701302_1219, duration: 131108
2013-10-31 18:42:20,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:20,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:20,371 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002. blk_7204826124865328506_1319
2013-10-31 18:42:20,395 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:44561 dest: /127.0.0.1:59471
2013-10-31 18:42:20,396 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:51365 dest: /127.0.0.1:34578
2013-10-31 18:42:20,396 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003. blk_6738845034354110760_1319
2013-10-31 18:42:20,397 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7204826124865328506_1319 src: /127.0.0.1:48737 dest: /127.0.0.1:54365
2013-10-31 18:42:20,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48737, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7204826124865328506_1319, duration: 1289022
2013-10-31 18:42:20,399 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,399 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,399 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51365, dest: /127.0.0.1:34578, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 1550018
2013-10-31 18:42:20,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,400 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44561, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7204826124865328506_1319, duration: 2071445
2013-10-31 18:42:20,400 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7204826124865328506_1319 terminating
2013-10-31 18:42:20,401 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:20,401 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:20,401 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,402 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7204826124865328506_1319 size 8
2013-10-31 18:42:20,411 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 from client DFSClient_attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,411 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 is closed by DFSClient_attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:20,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:44564 dest: /127.0.0.1:59471
2013-10-31 18:42:20,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:48739 dest: /127.0.0.1:54365
2013-10-31 18:42:20,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6738845034354110760_1319 src: /127.0.0.1:48457 dest: /127.0.0.1:37740
2013-10-31 18:42:20,423 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48457, dest: /127.0.0.1:37740, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6738845034354110760_1319, duration: 1175253
2013-10-31 18:42:20,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48739, dest: /127.0.0.1:54365, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6738845034354110760_1319, duration: 1421353
2013-10-31 18:42:20,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,424 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44564, dest: /127.0.0.1:59471, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0031_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6738845034354110760_1319, duration: 1802429
2013-10-31 18:42:20,424 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6738845034354110760_1319 terminating
2013-10-31 18:42:20,425 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,425 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:20,425 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:20,425 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,427 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6738845034354110760_1319 size 8
2013-10-31 18:42:20,992 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,992 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000002_0 0.0%
2013-10-31 18:42:20,997 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,997 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0031_m_000004_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:20,997 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000003_0 0.0%
2013-10-31 18:42:20,997 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000004_0 0.0%
2013-10-31 18:42:21,063 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:21,063 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0031_m_000006_0
2013-10-31 18:42:21,064 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000006_0 not found in cache
2013-10-31 18:42:22,067 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000001_0
2013-10-31 18:42:22,075 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000002_0
2013-10-31 18:42:22,075 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000003_0
2013-10-31 18:42:22,081 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0031_m_000004_0
2013-10-31 18:42:22,576 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:42:22,581 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:0+7
2013-10-31 18:42:22,582 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000000_0 is done.
2013-10-31 18:42:22,582 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000000_0 was -1
2013-10-31 18:42:22,582 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:42:22,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0 dst=null perm=null
2013-10-31 18:42:22,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:22,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:22,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000001_0 dst=null perm=null
2013-10-31 18:42:23,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0 dst=null perm=null
2013-10-31 18:42:23,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0 dst=null perm=null
2013-10-31 18:42:23,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0 dst=null perm=null
2013-10-31 18:42:23,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:23,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000002_0 dst=null perm=null
2013-10-31 18:42:23,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0/part-00004 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:23,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000003_0 dst=null perm=null
2013-10-31 18:42:23,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary/_attempt_20131031182606197_0031_m_000004_0 dst=null perm=null
2013-10-31 18:42:23,070 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:14+7
2013-10-31 18:42:23,072 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000002_0 is done.
2013-10-31 18:42:23,072 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000002_0 was -1
2013-10-31 18:42:23,072 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:42:23,102 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:21+7
2013-10-31 18:42:23,103 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000003_0 is done.
2013-10-31 18:42:23,103 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000003_0 was -1
2013-10-31 18:42:23,103 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:23,112 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:28+2
2013-10-31 18:42:23,113 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000004_0 is done.
2013-10-31 18:42:23,113 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000004_0 was -1
2013-10-31 18:42:23,113 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:25,071 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000000_0' has completed task_20131031182606197_0031_m_000000 successfully.
2013-10-31 18:42:25,079 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000002_0' has completed task_20131031182606197_0031_m_000002 successfully.
2013-10-31 18:42:25,080 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000003_0' has completed task_20131031182606197_0031_m_000003 successfully.
2013-10-31 18:42:25,084 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000004_0' has completed task_20131031182606197_0031_m_000004 successfully.
2013-10-31 18:42:25,248 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:42:25,250 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower+upper.txt:7+7
2013-10-31 18:42:25,251 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000001_0 is done.
2013-10-31 18:42:25,251 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000001_0 was -1
2013-10-31 18:42:25,252 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:28,077 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000001_0' has completed task_20131031182606197_0031_m_000001 successfully.
2013-10-31 18:42:28,079 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0031_m_000005_0' to tip task_20131031182606197_0031_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:28,082 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0031_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:42:28,082 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0031_m_000005_0 which needs 1 slots
2013-10-31 18:42:28,082 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0031_m_000005_0 which needs 1 slots
2013-10-31 18:42:28,118 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0031/attempt_20131031182606197_0031_m_000005_0. Attempting to reuse: jvm_20131031182606197_0031_m_-1600883262
2013-10-31 18:42:28,781 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0031_m_-1600883262 given task: attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,931 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000005_0 0.0%
2013-10-31 18:42:28,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary dst=null perm=null
2013-10-31 18:42:28,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:28,944 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS from client DFSClient_attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,944 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0031_m_000005_0
2013-10-31 18:42:28,948 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,948 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3405378349805446451 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3576267029470916644 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2501650952349019281 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:28,949 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:42:28,950 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_602449860203028534 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:28,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0031 dst=null perm=null
2013-10-31 18:42:31,556 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:31,556 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_3405378349805446451_1308
2013-10-31 18:42:31,875 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0031_m_000005_0 0.0% cleanup
2013-10-31 18:42:31,876 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0031_m_000005_0 is done.
2013-10-31 18:42:31,877 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0031_m_000005_0 was -1
2013-10-31 18:42:31,877 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:32,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data3/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:32,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data3/current/blk_602449860203028534 for deletion
2013-10-31 18:42:32,230 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data3/current/blk_-3576267029470916644
2013-10-31 18:42:32,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data4/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:32,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data3/current/blk_602449860203028534
2013-10-31 18:42:32,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data4/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:32,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data4/current/blk_2501650952349019281
2013-10-31 18:42:32,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data4/current/blk_3405378349805446451
2013-10-31 18:42:33,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data8/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:33,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data7/current/blk_602449860203028534 for deletion
2013-10-31 18:42:33,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data8/current/blk_-3576267029470916644
2013-10-31 18:42:33,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data7/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:33,429 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data7/current/blk_602449860203028534
2013-10-31 18:42:33,430 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data7/current/blk_3405378349805446451
2013-10-31 18:42:34,089 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0031_m_000005_0' has completed task_20131031182606197_0031_m_000005 successfully.
2013-10-31 18:42:34,090 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0031 has completed successfully.
2013-10-31 18:42:34,090 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0031,submitTime=1383244929056,launchTime=1383244929956,firstMapTaskLaunchTime=1383244936056,firstJobSetupTaskLaunchTime=1383244930038,firstJobCleanupTaskLaunchTime=1383244948079,finishTime=1383244954090,numMaps=5,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[08B8455663C7408F9361A4A94E27F7F0/80E663B36EBD4EAAA8EEE272CFCEEE34] test/(1/1) ...pesplatform/ungroupedanon
2013-10-31 18:42:34,095 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA. blk_6816440197397581714_1320
2013-10-31 18:42:34,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:48464 dest: /127.0.0.1:37740
2013-10-31 18:42:34,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:48748 dest: /127.0.0.1:54365
2013-10-31 18:42:34,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6816440197397581714_1320 src: /127.0.0.1:44575 dest: /127.0.0.1:59471
2013-10-31 18:42:34,111 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44575, dest: /127.0.0.1:59471, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6816440197397581714_1320, duration: 5300603
2013-10-31 18:42:34,112 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,112 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48748, dest: /127.0.0.1:54365, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6816440197397581714_1320, duration: 3926307
2013-10-31 18:42:34,113 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,113 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48464, dest: /127.0.0.1:37740, bytes: 25809, op: HDFS_WRITE, cliID: DFSClient_-1193761217, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6816440197397581714_1320, duration: 7893806
2013-10-31 18:42:34,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6816440197397581714_1320 terminating
2013-10-31 18:42:34,114 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,118 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,118 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6816440197397581714_1320 size 25809
2013-10-31 18:42:34,119 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA from client DFSClient_-1193761217
2013-10-31 18:42:34,119 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_logs/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA is closed by DFSClient_-1193761217
2013-10-31 18:42:34,126 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0031_1383244929056_hadoop_%5B08B8455663C7408F9361A4A94E27F7F0%2F80E663B36EBD4EAA to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:34,127 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000000_0'
2013-10-31 18:42:34,127 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000001_0'
2013-10-31 18:42:34,128 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000005_0'
2013-10-31 18:42:34,129 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000006_0'
2013-10-31 18:42:34,129 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:42:34,129 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:42:34,129 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4951964880204109736 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:42:34,130 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:34,130 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0031 being deleted.
2013-10-31 18:42:34,130 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000002_0'
2013-10-31 18:42:34,130 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000003_0'
2013-10-31 18:42:34,131 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0031_m_000004_0'
2013-10-31 18:42:34,132 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0031_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:42:34,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0031 dst=null perm=null
2013-10-31 18:42:34,137 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/_temporary
2013-10-31 18:42:34,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=null
2013-10-31 18:42:34,153 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 5
2013-10-31 18:42:34,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000 dst=null perm=null
2013-10-31 18:42:34,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001 dst=null perm=null
2013-10-31 18:42:34,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002 dst=null perm=null
2013-10-31 18:42:34,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003 dst=null perm=null
2013-10-31 18:42:34,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004 dst=null perm=null
2013-10-31 18:42:34,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000 dst=null perm=null
2013-10-31 18:42:34,158 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44577, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1487922476689862061_1315, duration: 297683
2013-10-31 18:42:34,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001 dst=null perm=null
2013-10-31 18:42:34,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51381, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 266174
2013-10-31 18:42:34,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002 dst=null perm=null
2013-10-31 18:42:34,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51382, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 280772
2013-10-31 18:42:34,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003 dst=null perm=null
2013-10-31 18:42:34,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48471, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6738845034354110760_1319, duration: 264483
2013-10-31 18:42:34,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004 dst=null perm=null
2013-10-31 18:42:34,164 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungroupedanon
2013-10-31 18:42:34,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon dst=null perm=null
2013-10-31 18:42:34,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00000 dst=null perm=null
2013-10-31 18:42:34,168 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48755, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1487922476689862061_1315, duration: 263114
2013-10-31 18:42:34,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00001 dst=null perm=null
2013-10-31 18:42:34,170 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51385, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3429000233400764538_1316, duration: 262582
2013-10-31 18:42:34,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00002 dst=null perm=null
2013-10-31 18:42:34,173 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51386, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7204826124865328506_1319, duration: 262858
2013-10-31 18:42:34,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00003 dst=null perm=null
2013-10-31 18:42:34,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44584, bytes: 12, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6738845034354110760_1319, duration: 262615
2013-10-31 18:42:34,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungroupedanon/part-00004 dst=null perm=null
2013-10-31 18:42:34,186 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:42:34,186 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:42:34,202 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:42:34,202 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:42:34,202 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup"]
2013-10-31 18:42:34,203 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:42:34,203 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 2
2013-10-31 18:42:34,203 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 2
2013-10-31 18:42:34,204 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/2)
2013-10-31 18:42:34,208 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:42:34,209 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:42:34,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:34,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:42:34,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,338 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar. blk_1160688926521489425_1321
2013-10-31 18:42:34,339 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:48476 dest: /127.0.0.1:37740
2013-10-31 18:42:34,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:48760 dest: /127.0.0.1:54365
2013-10-31 18:42:34,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:51390 dest: /127.0.0.1:34578
2013-10-31 18:42:34,356 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51390, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 6955618
2013-10-31 18:42:34,356 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,356 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48760, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1160688926521489425_1321, duration: 7714867
2013-10-31 18:42:34,357 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,357 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48476, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1160688926521489425_1321, duration: 9059597
2013-10-31 18:42:34,357 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,358 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1160688926521489425_1321 terminating
2013-10-31 18:42:34,360 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar from client DFSClient_-1596270109
2013-10-31 18:42:34,360 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:42:34,361 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,362 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:34,366 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar. New replication is 10
2013-10-31 18:42:34,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=null
2013-10-31 18:42:34,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,383 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:42:34,387 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:42:34,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:42:34,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,409 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split. New replication is 10
2013-10-31 18:42:34,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=null
2013-10-31 18:42:34,420 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split. blk_-3261905793271309273_1322
2013-10-31 18:42:34,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:48479 dest: /127.0.0.1:37740
2013-10-31 18:42:34,423 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:48763 dest: /127.0.0.1:54365
2013-10-31 18:42:34,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:44590 dest: /127.0.0.1:59471
2013-10-31 18:42:34,427 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3261905793271309273_1322 src: /127.0.0.1:51394 dest: /127.0.0.1:34578
2013-10-31 18:42:34,430 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51394, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3261905793271309273_1322, duration: 114639
2013-10-31 18:42:34,430 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,430 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,431 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44590, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3261905793271309273_1322, duration: 943113
2013-10-31 18:42:34,431 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,432 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48763, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3261905793271309273_1322, duration: 2172040
2013-10-31 18:42:34,432 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,433 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48479, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 3045446
2013-10-31 18:42:34,433 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3261905793271309273_1322 terminating
2013-10-31 18:42:34,433 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,436 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split from client DFSClient_-1596270109
2013-10-31 18:42:34,436 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split is closed by DFSClient_-1596270109
2013-10-31 18:42:34,437 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,437 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3261905793271309273_1322 size 1403
2013-10-31 18:42:34,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,481 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo. blk_-8353909620816440750_1323
2013-10-31 18:42:34,483 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:44592 dest: /127.0.0.1:59471
2013-10-31 18:42:34,484 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:51396 dest: /127.0.0.1:34578
2013-10-31 18:42:34,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8353909620816440750_1323 src: /127.0.0.1:48485 dest: /127.0.0.1:37740
2013-10-31 18:42:34,489 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48485, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8353909620816440750_1323, duration: 67293
2013-10-31 18:42:34,489 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51396, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8353909620816440750_1323, duration: 866987
2013-10-31 18:42:34,490 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,490 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,490 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44592, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8353909620816440750_1323, duration: 1726831
2013-10-31 18:42:34,491 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,491 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8353909620816440750_1323 terminating
2013-10-31 18:42:34,493 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8353909620816440750_1323 size 156
2013-10-31 18:42:34,493 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:42:34,494 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:42:34,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,521 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml. blk_-8254353095833524668_1324
2013-10-31 18:42:34,522 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:44595 dest: /127.0.0.1:59471
2013-10-31 18:42:34,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:51399 dest: /127.0.0.1:34578
2013-10-31 18:42:34,526 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8254353095833524668_1324 src: /127.0.0.1:48771 dest: /127.0.0.1:54365
2013-10-31 18:42:34,529 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48771, dest: /127.0.0.1:54365, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 205036
2013-10-31 18:42:34,529 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,529 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51399, dest: /127.0.0.1:34578, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8254353095833524668_1324, duration: 993961
2013-10-31 18:42:34,530 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,530 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44595, dest: /127.0.0.1:59471, bytes: 28257, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8254353095833524668_1324, duration: 1903885
2013-10-31 18:42:34,531 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8254353095833524668_1324 terminating
2013-10-31 18:42:34,531 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,534 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml from client DFSClient_-1596270109
2013-10-31 18:42:34,534 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:42:34,534 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,535 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8254353095833524668_1324 size 28257
2013-10-31 18:42:34,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=null
2013-10-31 18:42:34,549 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44599, bytes: 28481, op: HDFS_READ, cliID: DFSClient_1455126413, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8254353095833524668_1324, duration: 376657
2013-10-31 18:42:34,557 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_1160688926521489425_1321 to datanode(s) 127.0.0.1:59471
2013-10-31 18:42:34,557 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_4951964880204109736_1314 blk_-3576267029470916644_1309 blk_602449860203028534_1311 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:34,558 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_4951964880204109736_1314 blk_-3576267029470916644_1309 blk_2501650952349019281_1310 blk_3405378349805446451_1308
2013-10-31 18:42:34,567 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0032: nMaps=4 nReduces=1 max=-1
2013-10-31 18:42:34,568 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0032 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:42:34,568 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0032
2013-10-31 18:42:34,568 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0032 RESULT=SUCCESS
2013-10-31 18:42:34,568 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0032
2013-10-31 18:42:34,569 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0032
2013-10-31 18:42:34,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:34,598 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml. blk_-6329593982662489296_1326
2013-10-31 18:42:34,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:48491 dest: /127.0.0.1:37740
2013-10-31 18:42:34,602 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:51404 dest: /127.0.0.1:34578
2013-10-31 18:42:34,604 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6329593982662489296_1326 src: /127.0.0.1:48776 dest: /127.0.0.1:54365
2013-10-31 18:42:34,608 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48776, dest: /127.0.0.1:54365, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6329593982662489296_1326, duration: 581751
2013-10-31 18:42:34,608 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,609 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51404, dest: /127.0.0.1:34578, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6329593982662489296_1326, duration: 1406512
2013-10-31 18:42:34,609 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,609 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:34,610 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48491, dest: /127.0.0.1:37740, bytes: 28322, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-6329593982662489296_1326, duration: 2585752
2013-10-31 18:42:34,610 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6329593982662489296_1326 terminating
2013-10-31 18:42:34,613 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml from client DFSClient_1455126413
2013-10-31 18:42:34,613 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_conf.xml is closed by DFSClient_1455126413
2013-10-31 18:42:34,613 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:34,614 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-6329593982662489296_1326 size 28322
2013-10-31 18:42:35,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:35,020 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken. blk_6124728671195132175_1327
2013-10-31 18:42:35,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:48777 dest: /127.0.0.1:54365
2013-10-31 18:42:35,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:44604 dest: /127.0.0.1:59471
2013-10-31 18:42:35,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6124728671195132175_1327 src: /127.0.0.1:48496 dest: /127.0.0.1:37740
2013-10-31 18:42:35,028 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48496, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6124728671195132175_1327, duration: 70834
2013-10-31 18:42:35,028 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,028 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,028 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44604, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 873091
2013-10-31 18:42:35,029 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,029 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48777, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6124728671195132175_1327, duration: 1805574
2013-10-31 18:42:35,030 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6124728671195132175_1327 terminating
2013-10-31 18:42:35,032 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,034 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6124728671195132175_1327 size 116
2013-10-31 18:42:35,034 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken from client DFSClient_-1596270109
2013-10-31 18:42:35,034 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:42:35,038 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken
2013-10-31 18:42:35,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.splitmetainfo dst=null perm=null
2013-10-31 18:42:35,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44606, bytes: 160, op: HDFS_READ, cliID: DFSClient_1455126413, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8353909620816440750_1323, duration: 337069
2013-10-31 18:42:35,044 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0032 = 1449. Number of splits = 4
2013-10-31 18:42:35,044 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,044 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,045 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0032_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:42:35,047 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0032 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:42:35,048 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0032 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:42:35,960 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data6/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:35,960 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data5/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:35,960 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data6/current/blk_-3576267029470916644
2013-10-31 18:42:35,960 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data5/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:35,960 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data5/current/blk_2501650952349019281
2013-10-31 18:42:35,961 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data5/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:35,961 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data5/current/blk_3405378349805446451
2013-10-31 18:42:35,962 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data5/current/blk_4951964880204109736
2013-10-31 18:42:36,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3576267029470916644_1309 file build/test/data/dfs/data/data2/current/blk_-3576267029470916644 for deletion
2013-10-31 18:42:36,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_602449860203028534_1311 file build/test/data/dfs/data/data2/current/blk_602449860203028534 for deletion
2013-10-31 18:42:36,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3576267029470916644_1309 at file build/test/data/dfs/data/data2/current/blk_-3576267029470916644
2013-10-31 18:42:36,357 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2501650952349019281_1310 file build/test/data/dfs/data/data1/current/blk_2501650952349019281 for deletion
2013-10-31 18:42:36,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_602449860203028534_1311 at file build/test/data/dfs/data/data2/current/blk_602449860203028534
2013-10-31 18:42:36,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3405378349805446451_1308 file build/test/data/dfs/data/data1/current/blk_3405378349805446451 for deletion
2013-10-31 18:42:36,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2501650952349019281_1310 at file build/test/data/dfs/data/data1/current/blk_2501650952349019281
2013-10-31 18:42:36,358 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data2/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:36,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3405378349805446451_1308 at file build/test/data/dfs/data/data1/current/blk_3405378349805446451
2013-10-31 18:42:36,359 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data2/current/blk_4951964880204109736
2013-10-31 18:42:36,429 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_1160688926521489425_1321 to 127.0.0.1:59471
2013-10-31 18:42:36,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1160688926521489425_1321 src: /127.0.0.1:44607 dest: /127.0.0.1:59471
2013-10-31 18:42:36,432 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_1160688926521489425_1321 to /127.0.0.1:59471
2013-10-31 18:42:36,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1160688926521489425_1321 src: /127.0.0.1:44607 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:42:36,440 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1160688926521489425_1321 size 238055
2013-10-31 18:42:37,134 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0032_m_000005_0' to tip task_20131031182606197_0032_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:37,146 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:42:37,147 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000005_0 which needs 1 slots
2013-10-31 18:42:37,147 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000005_0 which needs 1 slots
2013-10-31 18:42:37,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken dst=null perm=null
2013-10-31 18:42:37,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44608, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 129027
2013-10-31 18:42:37,154 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadDelay 68 raw values into 2 aggregated values, total 7
2013-10-31 18:42:37,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=null
2013-10-31 18:42:37,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48784, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-2110053438, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 155689
2013-10-31 18:42:37,180 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:37,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=null
2013-10-31 18:42:37,197 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44611, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2110053438, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1160688926521489425_1321, duration: 1176859
2013-10-31 18:42:37,257 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0031_m_1888122456
2013-10-31 18:42:37,260 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group1974 with signal TERM. Exit code 0
2013-10-31 18:42:37,261 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_1459871651
2013-10-31 18:42:37,261 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_1459871651 spawned.
2013-10-31 18:42:37,262 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000005_0/taskjvm.sh
2013-10-31 18:42:37,538 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:37,538 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:37,538 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:37,539 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1888122456 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:42:37,558 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_4951964880204109736_1314
2013-10-31 18:42:38,231 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4951964880204109736_1314 file build/test/data/dfs/data/data4/current/blk_4951964880204109736 for deletion
2013-10-31 18:42:38,232 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4951964880204109736_1314 at file build/test/data/dfs/data/data4/current/blk_4951964880204109736
2013-10-31 18:42:38,276 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_1459871651 given task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:38,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:39,129 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,130 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000005_0 not found in cache
2013-10-31 18:42:39,130 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000001_0 not found in cache
2013-10-31 18:42:39,130 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000000_0 not found in cache
2013-10-31 18:42:39,130 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359130
2013-10-31 18:42:39,131 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,131 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000002_0 not found in cache
2013-10-31 18:42:39,132 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000003_0 not found in cache
2013-10-31 18:42:39,132 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359132
2013-10-31 18:42:39,132 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0031
2013-10-31 18:42:39,132 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0031_m_000004_0 not found in cache
2013-10-31 18:42:39,132 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0031 for user-log deletion with retainTimeStamp:1383331359132
2013-10-31 18:42:39,914 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_-1600883262 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:39,925 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2190 with signal TERM. Exit code 0
2013-10-31 18:42:40,092 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,092 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,092 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:40,092 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_-1600883262 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:42:40,146 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_1711463638 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,156 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2248 with signal TERM. Exit code 0
2013-10-31 18:42:40,161 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_-1236212079 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,167 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0031_m_1917937103 since job job_20131031182606197_0031 is dead
2013-10-31 18:42:40,175 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2283 with signal TERM. Exit code 0
2013-10-31 18:42:40,179 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2284 with signal TERM. Exit code 0
2013-10-31 18:42:40,343 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,343 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,343 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:40,344 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1711463638 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:40,352 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,352 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,352 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:40,352 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_-1236212079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:40,391 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:42:40,391 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:42:40,391 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:42:40,391 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0031_m_1917937103 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:42:41,695 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000005_0 0.0% setup
2013-10-31 18:42:41,698 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000005_0 is done.
2013-10-31 18:42:41,699 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000005_0 was -1
2013-10-31 18:42:41,699 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:43,153 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000005_0' has completed task_20131031182606197_0032_m_000005 successfully.
2013-10-31 18:42:45,393 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000000_0' to tip task_20131031182606197_0032_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:45,394 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000000
2013-10-31 18:42:45,396 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000001_0' to tip task_20131031182606197_0032_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:42:45,396 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:45,398 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000000_0 which needs 1 slots
2013-10-31 18:42:45,399 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000001
2013-10-31 18:42:45,400 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000000_0 which needs 1 slots
2013-10-31 18:42:45,400 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000002_0' to tip task_20131031182606197_0032_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:42:45,402 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:42:45,402 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000002
2013-10-31 18:42:45,402 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000001_0 which needs 1 slots
2013-10-31 18:42:45,403 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000001_0 which needs 1 slots
2013-10-31 18:42:45,404 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0032_m_000003_0' to tip task_20131031182606197_0032_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:42:45,406 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:42:45,407 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0032_m_000003
2013-10-31 18:42:45,407 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000002_0 which needs 1 slots
2013-10-31 18:42:45,407 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000002_0 which needs 1 slots
2013-10-31 18:42:45,409 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:42:45,409 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000003_0 which needs 1 slots
2013-10-31 18:42:45,410 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000003_0 which needs 1 slots
2013-10-31 18:42:45,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken dst=null perm=null
2013-10-31 18:42:45,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken dst=null perm=null
2013-10-31 18:42:45,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032/jobToken dst=null perm=null
2013-10-31 18:42:45,417 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48789, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6124728671195132175_1327, duration: 276452
2013-10-31 18:42:45,418 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44616, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 381668
2013-10-31 18:42:45,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=null
2013-10-31 18:42:45,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=null
2013-10-31 18:42:45,431 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51422, bytes: 28481, op: HDFS_READ, cliID: DFSClient_229997246, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8254353095833524668_1324, duration: 1062327
2013-10-31 18:42:45,433 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48794, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-1391221529, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 3362681
2013-10-31 18:42:45,440 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-549426104
2013-10-31 18:42:45,442 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-549426104 spawned.
2013-10-31 18:42:45,443 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000000_0/taskjvm.sh
2013-10-31 18:42:45,449 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44621, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6124728671195132175_1327, duration: 119222
2013-10-31 18:42:45,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.xml dst=null perm=null
2013-10-31 18:42:45,460 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48797, bytes: 28481, op: HDFS_READ, cliID: DFSClient_-892306882, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8254353095833524668_1324, duration: 181594
2013-10-31 18:42:45,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=null
2013-10-31 18:42:45,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51427, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1391221529, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 631477
2013-10-31 18:42:45,471 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=null
2013-10-31 18:42:45,485 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51428, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-892306882, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1160688926521489425_1321, duration: 592503
2013-10-31 18:42:45,503 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:42:45,562 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-907495285
2013-10-31 18:42:45,562 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_679453739
2013-10-31 18:42:45,563 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-907495285 spawned.
2013-10-31 18:42:45,566 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_679453739 spawned.
2013-10-31 18:42:45,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.jar dst=null perm=null
2013-10-31 18:42:45,570 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000003_0/taskjvm.sh
2013-10-31 18:42:45,572 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000002_0/taskjvm.sh
2013-10-31 18:42:45,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48517, bytes: 239915, op: HDFS_READ, cliID: DFSClient_229997246, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1160688926521489425_1321, duration: 1661176
2013-10-31 18:42:46,357 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-549426104 given task: attempt_20131031182606197_0032_m_000000_0
2013-10-31 18:42:46,741 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_m_-1126554979
2013-10-31 18:42:46,742 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_m_-1126554979 spawned.
2013-10-31 18:42:46,743 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_m_000001_0/taskjvm.sh
2013-10-31 18:42:46,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=null
2013-10-31 18:42:46,850 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48803, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3261905793271309273_1322, duration: 168940
2013-10-31 18:42:46,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:42:46,889 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51433, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000000_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 253950
2013-10-31 18:42:47,135 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0032_m_000000_0 is 1741 ms debug.
2013-10-31 18:42:47,728 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-907495285 given task: attempt_20131031182606197_0032_m_000003_0
2013-10-31 18:42:47,959 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-1126554979 given task: attempt_20131031182606197_0032_m_000001_0
2013-10-31 18:42:47,970 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_679453739 given task: attempt_20131031182606197_0032_m_000002_0
2013-10-31 18:42:48,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=null
2013-10-31 18:42:48,221 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48526, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 126521
2013-10-31 18:42:48,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:42:48,260 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48527, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000003_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163044
2013-10-31 18:42:48,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=null
2013-10-31 18:42:48,455 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51442, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3261905793271309273_1322, duration: 161994
2013-10-31 18:42:48,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:42:48,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032/job.split dst=null perm=null
2013-10-31 18:42:48,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48531, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000002_0, offset: 512, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3261905793271309273_1322, duration: 169610
2013-10-31 18:42:48,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:42:48,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48815, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 151633
2013-10-31 18:42:48,745 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48816, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0032_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 184484
2013-10-31 18:42:49,776 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:42:49,779 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000000_0 is done.
2013-10-31 18:42:49,780 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000000_0 was 54
2013-10-31 18:42:49,780 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:50,398 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:50,399 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0032_m_000005_0
2013-10-31 18:42:50,399 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0032_m_000005_0 not found in cache
2013-10-31 18:42:51,151 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:42:51,154 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000003_0 is done.
2013-10-31 18:42:51,154 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000003_0 was 53
2013-10-31 18:42:51,155 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,385 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:42:51,390 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000001_0 is done.
2013-10-31 18:42:51,390 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000001_0 was 74
2013-10-31 18:42:51,390 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,402 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000000_0' has completed task_20131031182606197_0032_m_000000 successfully.
2013-10-31 18:42:51,403 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0032_r_000000_0' to tip task_20131031182606197_0032_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:42:51,408 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:42:51,408 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_r_000000_0 which needs 1 slots
2013-10-31 18:42:51,408 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_r_000000_0 which needs 1 slots
2013-10-31 18:42:51,412 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000001_0' has completed task_20131031182606197_0032_m_000001 successfully.
2013-10-31 18:42:51,414 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000003_0' has completed task_20131031182606197_0032_m_000003 successfully.
2013-10-31 18:42:51,427 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:42:51,429 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000002_0 is done.
2013-10-31 18:42:51,429 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000002_0 was 73
2013-10-31 18:42:51,429 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:42:51,442 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0032_r_-594210753
2013-10-31 18:42:51,444 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0032_r_-594210753 spawned.
2013-10-31 18:42:51,445 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0032/attempt_20131031182606197_0032_r_000000_0/taskjvm.sh
2013-10-31 18:42:52,413 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_r_-594210753 given task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:54,454 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000002_0' has completed task_20131031182606197_0032_m_000002 successfully.
2013-10-31 18:42:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:42:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,026 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,047 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,053 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,059 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:42:56,060 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:42:58,084 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42851, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000000_0, duration: 5987188
2013-10-31 18:42:58,100 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45528, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000001_0, duration: 9489271
2013-10-31 18:42:58,115 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50487, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000003_0, duration: 10828195
2013-10-31 18:42:58,133 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40833, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0032_m_000002_0, duration: 12560875
2013-10-31 18:42:58,902 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:58,958 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:59,011 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:42:59,219 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1716 Total time for transactions(ms): 32Number of transactions batched in Syncs: 145 Number of syncs: 1204 SyncTimes(ms): 77100 16678
2013-10-31 18:42:59,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:42:59,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:42:59,251 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000. blk_1107095905103096836_1328
2013-10-31 18:42:59,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:51453 dest: /127.0.0.1:34578
2013-10-31 18:42:59,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:44651 dest: /127.0.0.1:59471
2013-10-31 18:42:59,288 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1107095905103096836_1328 src: /127.0.0.1:48826 dest: /127.0.0.1:54365
2013-10-31 18:42:59,293 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48826, dest: /127.0.0.1:54365, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1107095905103096836_1328, duration: 1647751
2013-10-31 18:42:59,293 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,293 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44651, dest: /127.0.0.1:59471, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1107095905103096836_1328, duration: 3539623
2013-10-31 18:42:59,293 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,293 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51453, dest: /127.0.0.1:34578, bytes: 310, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0032_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1107095905103096836_1328, duration: 3726849
2013-10-31 18:42:59,294 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1107095905103096836_1328 terminating
2013-10-31 18:42:59,295 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,295 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,296 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:59,296 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:42:59,297 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1107095905103096836_1328 size 310
2013-10-31 18:42:59,331 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0032_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:42:59,331 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 0.33333334% reduce > copy (4 of 4 at 0.00 MB/s)
2013-10-31 18:43:00,417 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 4 OK for attempt_20131031182606197_0032_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:43:00,418 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:01,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0 dst=null perm=null
2013-10-31 18:43:01,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:01,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:01,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary/_attempt_20131031182606197_0032_r_000000_0 dst=null perm=null
2013-10-31 18:43:01,938 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:01,940 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:01,941 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_r_000000_0 is done.
2013-10-31 18:43:01,941 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_r_000000_0 was -1
2013-10-31 18:43:01,941 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:03,421 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_r_000000_0' has completed task_20131031182606197_0032_r_000000 successfully.
2013-10-31 18:43:03,425 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0032_m_000004_0' to tip task_20131031182606197_0032_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:03,427 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0032_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:43:03,428 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0032_m_000004_0 which needs 1 slots
2013-10-31 18:43:03,428 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0032_m_000004_0 which needs 1 slots
2013-10-31 18:43:03,459 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0032/attempt_20131031182606197_0032_m_000004_0. Attempting to reuse: jvm_20131031182606197_0032_m_-549426104
2013-10-31 18:43:03,857 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0032_m_-549426104 given task: attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:03,994 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000004_0 0.0%
2013-10-31 18:43:04,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_temporary dst=null perm=null
2013-10-31 18:43:04,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:04,011 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS from client DFSClient_attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:04,011 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0032_m_000004_0
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1160688926521489425 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,016 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3261905793271309273 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8353909620816440750 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:04,017 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8254353095833524668 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:04,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0032 dst=null perm=null
2013-10-31 18:43:04,562 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-8254353095833524668_1324 blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:04,563 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-8254353095833524668_1324 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:05,241 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data4/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:05,241 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data3/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:05,241 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data4/current/blk_-8254353095833524668
2013-10-31 18:43:05,242 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data4/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:05,242 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data3/current/blk_-3261905793271309273
2013-10-31 18:43:05,242 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data4/current/blk_1160688926521489425
2013-10-31 18:43:06,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data1/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:06,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data2/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:06,367 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data1/current/blk_-8353909620816440750
2013-10-31 18:43:06,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data2/current/blk_-8254353095833524668
2013-10-31 18:43:06,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data2/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:06,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data1/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:06,368 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data2/current/blk_-3261905793271309273
2013-10-31 18:43:06,369 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data1/current/blk_1160688926521489425
2013-10-31 18:43:06,942 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0032_m_000004_0 0.0% cleanup
2013-10-31 18:43:06,944 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0032_m_000004_0 is done.
2013-10-31 18:43:06,944 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0032_m_000004_0 was -1
2013-10-31 18:43:06,944 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:07,563 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:07,563 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-8254353095833524668_1324 blk_-8353909620816440750_1323 blk_-3261905793271309273_1322 blk_1160688926521489425_1321
2013-10-31 18:43:08,428 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:08,428 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0032_r_000000_0
2013-10-31 18:43:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data5/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8254353095833524668_1324 file build/test/data/dfs/data/data6/current/blk_-8254353095833524668 for deletion
2013-10-31 18:43:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data5/current/blk_-8353909620816440750
2013-10-31 18:43:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data6/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:08,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8254353095833524668_1324 at file build/test/data/dfs/data/data6/current/blk_-8254353095833524668
2013-10-31 18:43:08,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data6/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:08,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data6/current/blk_-3261905793271309273
2013-10-31 18:43:08,973 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data6/current/blk_1160688926521489425
2013-10-31 18:43:09,434 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0032_m_000004_0' has completed task_20131031182606197_0032_m_000004 successfully.
2013-10-31 18:43:09,435 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0032 has completed successfully.
2013-10-31 18:43:09,435 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0032,submitTime=1383244954540,launchTime=1383244955047,firstMapTaskLaunchTime=1383244965393,firstReduceTaskLaunchTime=1383244971403,firstJobSetupTaskLaunchTime=1383244957134,firstJobCleanupTaskLaunchTime=1383244983424,finishTime=1383244989435,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=28,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[9E722C5C544D4F6E9EA520E87CC987CE/D4BCCB91172545369A5D752C23CF3411] test/(1/2)
2013-10-31 18:43:09,439 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536. blk_5204921068052043086_1329
2013-10-31 18:43:09,442 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8353909620816440750_1323 file build/test/data/dfs/data/data8/current/blk_-8353909620816440750 for deletion
2013-10-31 18:43:09,444 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3261905793271309273_1322 file build/test/data/dfs/data/data7/current/blk_-3261905793271309273 for deletion
2013-10-31 18:43:09,444 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8353909620816440750_1323 at file build/test/data/dfs/data/data8/current/blk_-8353909620816440750
2013-10-31 18:43:09,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1160688926521489425_1321 file build/test/data/dfs/data/data8/current/blk_1160688926521489425 for deletion
2013-10-31 18:43:09,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:48829 dest: /127.0.0.1:54365
2013-10-31 18:43:09,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3261905793271309273_1322 at file build/test/data/dfs/data/data7/current/blk_-3261905793271309273
2013-10-31 18:43:09,445 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1160688926521489425_1321 at file build/test/data/dfs/data/data8/current/blk_1160688926521489425
2013-10-31 18:43:09,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:51459 dest: /127.0.0.1:34578
2013-10-31 18:43:09,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5204921068052043086_1329 src: /127.0.0.1:48549 dest: /127.0.0.1:37740
2013-10-31 18:43:09,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48549, dest: /127.0.0.1:37740, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5204921068052043086_1329, duration: 69246
2013-10-31 18:43:09,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,457 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51459, dest: /127.0.0.1:34578, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5204921068052043086_1329, duration: 4989859
2013-10-31 18:43:09,457 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,458 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48829, dest: /127.0.0.1:54365, bytes: 28270, op: HDFS_WRITE, cliID: DFSClient_1455126413, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5204921068052043086_1329, duration: 6056686
2013-10-31 18:43:09,458 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5204921068052043086_1329 terminating
2013-10-31 18:43:09,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,461 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 from client DFSClient_1455126413
2013-10-31 18:43:09,461 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/_logs/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 is closed by DFSClient_1455126413
2013-10-31 18:43:09,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5204921068052043086_1329 size 28270
2013-10-31 18:43:09,468 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0032_1383244954540_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2FD4BCCB9117254536 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:09,469 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000000_0'
2013-10-31 18:43:09,469 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000004_0'
2013-10-31 18:43:09,470 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000005_0'
2013-10-31 18:43:09,470 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_r_000000_0'
2013-10-31 18:43:09,471 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:09,472 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:09,472 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6124728671195132175 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:09,472 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000003_0'
2013-10-31 18:43:09,473 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000001_0'
2013-10-31 18:43:09,475 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0032_m_000002_0'
2013-10-31 18:43:09,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0032 dst=null perm=null
2013-10-31 18:43:09,478 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0032_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:09,480 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (2/2) ...dpipesplatform/groupgroup
2013-10-31 18:43:09,486 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:43:09,487 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:43:09,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:09,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:43:09,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:09,510 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar. blk_-2470905291057701022_1330
2013-10-31 18:43:09,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:48834 dest: /127.0.0.1:54365
2013-10-31 18:43:09,513 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:51464 dest: /127.0.0.1:34578
2013-10-31 18:43:09,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:44662 dest: /127.0.0.1:59471
2013-10-31 18:43:09,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44662, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2470905291057701022_1330, duration: 6908161
2013-10-31 18:43:09,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,523 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51464, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2470905291057701022_1330, duration: 6672042
2013-10-31 18:43:09,523 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,524 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48834, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2470905291057701022_1330, duration: 6666359
2013-10-31 18:43:09,524 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2470905291057701022_1330 terminating
2013-10-31 18:43:09,526 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,526 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,527 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:09,926 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar from client DFSClient_-1596270109
2013-10-31 18:43:09,927 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:43:09,935 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar. New replication is 10
2013-10-31 18:43:09,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar dst=null perm=null
2013-10-31 18:43:09,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:09,950 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:43:09,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2 dst=null perm=null
2013-10-31 18:43:09,955 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:09,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000 dst=null perm=null
2013-10-31 18:43:09,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:10,564 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2470905291057701022_1330 to datanode(s) 127.0.0.1:37740
2013-10-31 18:43:10,565 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_6124728671195132175_1327
2013-10-31 18:43:10,565 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_6124728671195132175_1327
2013-10-31 18:43:11,243 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2470905291057701022_1330 to 127.0.0.1:37740
2013-10-31 18:43:11,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2470905291057701022_1330 src: /127.0.0.1:48554 dest: /127.0.0.1:37740
2013-10-31 18:43:11,245 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2470905291057701022_1330 to /127.0.0.1:37740
2013-10-31 18:43:11,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2470905291057701022_1330 src: /127.0.0.1:48554 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:43:11,252 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2470905291057701022_1330 size 238055
2013-10-31 18:43:11,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,804 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split. New replication is 10
2013-10-31 18:43:11,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split dst=null perm=null
2013-10-31 18:43:11,812 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split. blk_-7533221922779966677_1331
2013-10-31 18:43:11,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:48838 dest: /127.0.0.1:54365
2013-10-31 18:43:11,816 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:51468 dest: /127.0.0.1:34578
2013-10-31 18:43:11,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:44666 dest: /127.0.0.1:59471
2013-10-31 18:43:11,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7533221922779966677_1331 src: /127.0.0.1:48558 dest: /127.0.0.1:37740
2013-10-31 18:43:11,822 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48558, dest: /127.0.0.1:37740, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-7533221922779966677_1331, duration: 996133
2013-10-31 18:43:11,823 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,823 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44666, dest: /127.0.0.1:59471, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7533221922779966677_1331, duration: 910306
2013-10-31 18:43:11,823 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,824 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51468, dest: /127.0.0.1:34578, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7533221922779966677_1331, duration: 1795881
2013-10-31 18:43:11,825 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,825 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48838, dest: /127.0.0.1:54365, bytes: 351, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7533221922779966677_1331, duration: 2967212
2013-10-31 18:43:11,826 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-7533221922779966677_1331 terminating
2013-10-31 18:43:11,826 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,829 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,830 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7533221922779966677_1331 size 351
2013-10-31 18:43:11,830 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split from client DFSClient_-1596270109
2013-10-31 18:43:11,831 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split is closed by DFSClient_-1596270109
2013-10-31 18:43:11,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,849 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo. blk_7520970391311344253_1332
2013-10-31 18:43:11,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:48842 dest: /127.0.0.1:54365
2013-10-31 18:43:11,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:48560 dest: /127.0.0.1:37740
2013-10-31 18:43:11,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7520970391311344253_1332 src: /127.0.0.1:51473 dest: /127.0.0.1:34578
2013-10-31 18:43:11,857 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51473, dest: /127.0.0.1:34578, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7520970391311344253_1332, duration: 89043
2013-10-31 18:43:11,858 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,859 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48560, dest: /127.0.0.1:37740, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7520970391311344253_1332, duration: 2840758
2013-10-31 18:43:11,859 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,860 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48842, dest: /127.0.0.1:54365, bytes: 45, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7520970391311344253_1332, duration: 3706044
2013-10-31 18:43:11,860 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7520970391311344253_1332 terminating
2013-10-31 18:43:11,862 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,863 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,864 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:43:11,864 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:43:11,865 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7520970391311344253_1332 size 45
2013-10-31 18:43:11,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,893 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml. blk_5794936352752417851_1333
2013-10-31 18:43:11,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:48845 dest: /127.0.0.1:54365
2013-10-31 18:43:11,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:44672 dest: /127.0.0.1:59471
2013-10-31 18:43:11,898 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5794936352752417851_1333 src: /127.0.0.1:48564 dest: /127.0.0.1:37740
2013-10-31 18:43:11,901 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48564, dest: /127.0.0.1:37740, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5794936352752417851_1333, duration: 277484
2013-10-31 18:43:11,901 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,902 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44672, dest: /127.0.0.1:59471, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5794936352752417851_1333, duration: 1059122
2013-10-31 18:43:11,902 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,902 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,903 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48845, dest: /127.0.0.1:54365, bytes: 28569, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5794936352752417851_1333, duration: 1901496
2013-10-31 18:43:11,903 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,903 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5794936352752417851_1333 terminating
2013-10-31 18:43:11,905 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml from client DFSClient_-1596270109
2013-10-31 18:43:11,905 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:43:11,906 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5794936352752417851_1333 size 28569
2013-10-31 18:43:11,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml dst=null perm=null
2013-10-31 18:43:11,923 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48566, bytes: 28793, op: HDFS_READ, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5794936352752417851_1333, duration: 428407
2013-10-31 18:43:11,942 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0033: nMaps=1 nReduces=1 max=-1
2013-10-31 18:43:11,942 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0033 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:43:11,942 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0033
2013-10-31 18:43:11,942 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0033 RESULT=SUCCESS
2013-10-31 18:43:11,943 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0033
2013-10-31 18:43:11,944 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0033
2013-10-31 18:43:11,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,971 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data5/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:11,972 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data5/current/blk_6124728671195132175
2013-10-31 18:43:11,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:11,980 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml. blk_-3092982248583927606_1335
2013-10-31 18:43:11,982 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:44676 dest: /127.0.0.1:59471
2013-10-31 18:43:11,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:48568 dest: /127.0.0.1:37740
2013-10-31 18:43:11,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3092982248583927606_1335 src: /127.0.0.1:48852 dest: /127.0.0.1:54365
2013-10-31 18:43:11,989 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48852, dest: /127.0.0.1:54365, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3092982248583927606_1335, duration: 555807
2013-10-31 18:43:11,990 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,990 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:11,990 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48568, dest: /127.0.0.1:37740, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3092982248583927606_1335, duration: 1882042
2013-10-31 18:43:11,991 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,991 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44676, dest: /127.0.0.1:59471, bytes: 28634, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3092982248583927606_1335, duration: 2751577
2013-10-31 18:43:11,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:11,992 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3092982248583927606_1335 terminating
2013-10-31 18:43:11,996 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml from client DFSClient_1872362589
2013-10-31 18:43:11,997 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_conf.xml is closed by DFSClient_1872362589
2013-10-31 18:43:11,997 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3092982248583927606_1335 size 28634
2013-10-31 18:43:12,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:12,010 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken. blk_5135335180789234108_1336
2013-10-31 18:43:12,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:48570 dest: /127.0.0.1:37740
2013-10-31 18:43:12,014 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:44680 dest: /127.0.0.1:59471
2013-10-31 18:43:12,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5135335180789234108_1336 src: /127.0.0.1:48855 dest: /127.0.0.1:54365
2013-10-31 18:43:12,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48855, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5135335180789234108_1336, duration: 74075
2013-10-31 18:43:12,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,019 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44680, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5135335180789234108_1336, duration: 846767
2013-10-31 18:43:12,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,019 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,020 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48570, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5135335180789234108_1336, duration: 1787639
2013-10-31 18:43:12,020 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,020 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5135335180789234108_1336 terminating
2013-10-31 18:43:12,025 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5135335180789234108_1336 size 116
2013-10-31 18:43:12,025 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken from client DFSClient_-1596270109
2013-10-31 18:43:12,026 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:43:12,031 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken
2013-10-31 18:43:12,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.splitmetainfo dst=null perm=null
2013-10-31 18:43:12,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48573, bytes: 49, op: HDFS_READ, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7520970391311344253_1332, duration: 287083
2013-10-31 18:43:12,036 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0033 = 310. Number of splits = 1
2013-10-31 18:43:12,036 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,036 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,036 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0033_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:12,037 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0033 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:43:12,037 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0033 initialized successfully with 1 map tasks and 1 reduce tasks.
2013-10-31 18:43:12,441 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data8/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:12,442 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data8/current/blk_6124728671195132175
2013-10-31 18:43:12,476 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0033_m_000002_0' to tip task_20131031182606197_0033_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:12,485 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:43:12,485 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000002_0 which needs 1 slots
2013-10-31 18:43:12,486 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000002_0 which needs 1 slots
2013-10-31 18:43:12,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033/jobToken dst=null perm=null
2013-10-31 18:43:12,494 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48574, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5135335180789234108_1336, duration: 275650
2013-10-31 18:43:12,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.xml dst=null perm=null
2013-10-31 18:43:12,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44685, bytes: 28793, op: HDFS_READ, cliID: DFSClient_-1724905577, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5794936352752417851_1333, duration: 397219
2013-10-31 18:43:12,533 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:12,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.jar dst=null perm=null
2013-10-31 18:43:12,562 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44686, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1724905577, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2470905291057701022_1330, duration: 1220869
2013-10-31 18:43:12,660 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0032_m_1459871651
2013-10-31 18:43:12,667 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2683 with signal TERM. Exit code 0
2013-10-31 18:43:12,667 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_m_317850141
2013-10-31 18:43:12,667 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_m_317850141 spawned.
2013-10-31 18:43:12,669 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_m_000002_0/taskjvm.sh
2013-10-31 18:43:13,547 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:13,547 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:13,547 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:13,547 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_1459871651 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:13,565 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_6124728671195132175_1327
2013-10-31 18:43:14,243 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6124728671195132175_1327 file build/test/data/dfs/data/data4/current/blk_6124728671195132175 for deletion
2013-10-31 18:43:14,244 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6124728671195132175_1327 at file build/test/data/dfs/data/data4/current/blk_6124728671195132175
2013-10-31 18:43:14,256 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_317850141 given task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:14,472 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,472 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0032_m_000004_0 not found in cache
2013-10-31 18:43:14,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394473
2013-10-31 18:43:14,473 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,473 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394473
2013-10-31 18:43:14,475 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,476 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394476
2013-10-31 18:43:14,478 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0032
2013-10-31 18:43:14,478 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0032 for user-log deletion with retainTimeStamp:1383331394478
2013-10-31 18:43:14,480 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_r_-594210753 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,485 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3117 with signal TERM. Exit code 0
2013-10-31 18:43:14,611 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_679453739 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,616 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2962 with signal TERM. Exit code 0
2013-10-31 18:43:14,640 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:14,640 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:14,640 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:14,640 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_r_-594210753 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:14,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:14,808 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:14,808 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:14,808 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:14,808 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_679453739 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:14,983 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-549426104 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:14,993 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2861 with signal TERM. Exit code 0
2013-10-31 18:43:15,176 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:15,176 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:15,176 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:15,176 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-549426104 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:43:15,734 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-907495285 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:15,744 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2926 with signal TERM. Exit code 0
2013-10-31 18:43:15,968 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0032_m_-1126554979 since job job_20131031182606197_0032 is dead
2013-10-31 18:43:15,974 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group2963 with signal TERM. Exit code 0
2013-10-31 18:43:15,997 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:15,997 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:15,997 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:15,998 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-907495285 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:16,189 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:16,189 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:16,189 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:16,189 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0032_m_-1126554979 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:17,707 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000002_0 0.0% setup
2013-10-31 18:43:17,709 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000002_0 is done.
2013-10-31 18:43:17,710 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000002_0 was -1
2013-10-31 18:43:17,710 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:18,492 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000002_0' has completed task_20131031182606197_0033_m_000002 successfully.
2013-10-31 18:43:18,727 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0033_m_000000_0' to tip task_20131031182606197_0033_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:18,728 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0033_m_000000
2013-10-31 18:43:18,731 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:18,731 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000000_0 which needs 1 slots
2013-10-31 18:43:18,732 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000000_0 which needs 1 slots
2013-10-31 18:43:18,760 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_m_1954828324
2013-10-31 18:43:18,761 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_m_1954828324 spawned.
2013-10-31 18:43:18,763 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_m_000000_0/taskjvm.sh
2013-10-31 18:43:19,566 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_1954828324 given task: attempt_20131031182606197_0033_m_000000_0
2013-10-31 18:43:20,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033/job.split dst=null perm=null
2013-10-31 18:43:20,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48866, bytes: 355, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0033_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7533221922779966677_1331, duration: 148955
2013-10-31 18:43:20,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000 dst=null perm=null
2013-10-31 18:43:20,141 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44693, bytes: 314, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0033_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1107095905103096836_1328, duration: 263311
2013-10-31 18:43:23,013 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2/part-00000:0+310
2013-10-31 18:43:23,016 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000000_0 is done.
2013-10-31 18:43:23,016 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000000_0 was 230
2013-10-31 18:43:23,017 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:23,732 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:23,732 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0033_m_000002_0
2013-10-31 18:43:23,732 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0033_m_000002_0 not found in cache
2013-10-31 18:43:24,738 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000000_0' has completed task_20131031182606197_0033_m_000000 successfully.
2013-10-31 18:43:24,739 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0033_r_000000_0' to tip task_20131031182606197_0033_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:24,742 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:24,743 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_r_000000_0 which needs 1 slots
2013-10-31 18:43:24,743 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_r_000000_0 which needs 1 slots
2013-10-31 18:43:24,777 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0033_r_103233333
2013-10-31 18:43:24,778 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0033_r_103233333 spawned.
2013-10-31 18:43:24,780 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0033/attempt_20131031182606197_0033_r_000000_0/taskjvm.sh
2013-10-31 18:43:25,722 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_r_103233333 given task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:31,465 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42901, bytes: 230, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0033_m_000000_0, duration: 10775198
2013-10-31 18:43:32,238 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,308 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_800740813804517052_1298
2013-10-31 18:43:32,309 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,375 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:32,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:32,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:32,721 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000. blk_-3315728293189659166_1337
2013-10-31 18:43:32,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:51500 dest: /127.0.0.1:34578
2013-10-31 18:43:32,763 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:48589 dest: /127.0.0.1:37740
2013-10-31 18:43:32,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3315728293189659166_1337 src: /127.0.0.1:48873 dest: /127.0.0.1:54365
2013-10-31 18:43:32,765 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48873, dest: /127.0.0.1:54365, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3315728293189659166_1337, duration: 919282
2013-10-31 18:43:32,766 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,766 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48589, dest: /127.0.0.1:37740, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3315728293189659166_1337, duration: 1313518
2013-10-31 18:43:32,766 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,766 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51500, dest: /127.0.0.1:34578, bytes: 128, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0033_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3315728293189659166_1337, duration: 1718851
2013-10-31 18:43:32,767 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3315728293189659166_1337 terminating
2013-10-31 18:43:32,771 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,771 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:32,772 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:32,772 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,772 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3315728293189659166_1337 size 128
2013-10-31 18:43:32,810 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0033_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:43:32,810 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 0.33333334% reduce > copy (1 of 1 at 0.00 MB/s)
2013-10-31 18:43:33,751 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0033_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:43:33,753 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:33,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0 dst=null perm=null
2013-10-31 18:43:33,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:33,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:33,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary/_attempt_20131031182606197_0033_r_000000_0 dst=null perm=null
2013-10-31 18:43:35,289 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:35,292 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_r_000000_0 1.0% reduce > reduce
2013-10-31 18:43:35,293 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_r_000000_0 is done.
2013-10-31 18:43:35,294 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_r_000000_0 was -1
2013-10-31 18:43:35,294 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:36,757 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_r_000000_0' has completed task_20131031182606197_0033_r_000000 successfully.
2013-10-31 18:43:36,760 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0033_m_000001_0' to tip task_20131031182606197_0033_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:36,763 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0033_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:43:36,763 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0033_m_000001_0 which needs 1 slots
2013-10-31 18:43:36,763 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0033_m_000001_0 which needs 1 slots
2013-10-31 18:43:36,797 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0033/attempt_20131031182606197_0033_m_000001_0. Attempting to reuse: jvm_20131031182606197_0033_m_317850141
2013-10-31 18:43:37,806 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0033_m_317850141 given task: attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,917 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000001_0 0.0%
2013-10-31 18:43:37,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary dst=null perm=null
2013-10-31 18:43:37,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:37,964 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,964 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0033_m_000001_0
2013-10-31 18:43:37,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2470905291057701022 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,972 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-7533221922779966677 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,973 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,974 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:37,974 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7520970391311344253 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,974 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:37,974 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:37,974 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5794936352752417851 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:37,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0033 dst=null perm=null
2013-10-31 18:43:40,570 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331 blk_7520970391311344253_1332
2013-10-31 18:43:40,570 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331 blk_7520970391311344253_1332
2013-10-31 18:43:40,889 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0033_m_000001_0 0.0% cleanup
2013-10-31 18:43:40,890 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0033_m_000001_0 is done.
2013-10-31 18:43:40,891 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0033_m_000001_0 was -1
2013-10-31 18:43:40,891 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:41,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data4/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:41,253 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data3/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:41,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data4/current/blk_-7533221922779966677
2013-10-31 18:43:41,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data4/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:41,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data3/current/blk_-2470905291057701022
2013-10-31 18:43:41,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data3/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:41,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data4/current/blk_5794936352752417851
2013-10-31 18:43:41,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data3/current/blk_7520970391311344253
2013-10-31 18:43:41,763 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:41,764 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0033_r_000000_0
2013-10-31 18:43:42,452 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data7/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:42,452 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data8/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:42,452 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data7/current/blk_-7533221922779966677
2013-10-31 18:43:42,452 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data7/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:42,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data8/current/blk_-2470905291057701022
2013-10-31 18:43:42,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data7/current/blk_5794936352752417851
2013-10-31 18:43:42,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data8/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:42,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data8/current/blk_7520970391311344253
2013-10-31 18:43:42,770 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0033_m_000001_0' has completed task_20131031182606197_0033_m_000001 successfully.
2013-10-31 18:43:42,771 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0033 has completed successfully.
2013-10-31 18:43:42,771 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0033,submitTime=1383244991914,launchTime=1383244992037,firstMapTaskLaunchTime=1383244998727,firstReduceTaskLaunchTime=1383245004739,firstJobSetupTaskLaunchTime=1383244992476,firstJobCleanupTaskLaunchTime=1383245016760,finishTime=1383245022771,numMaps=1,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=13,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[9E722C5C544D4F6E9EA520E87CC987CE/8E6D0FBB17654B29B133D7BC321806AC] test/(2/2) ...dpipesplatform/groupgroup
2013-10-31 18:43:42,775 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29. blk_6508054468461277982_1338
2013-10-31 18:43:42,777 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:48596 dest: /127.0.0.1:37740
2013-10-31 18:43:42,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:44706 dest: /127.0.0.1:59471
2013-10-31 18:43:42,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6508054468461277982_1338 src: /127.0.0.1:51510 dest: /127.0.0.1:34578
2013-10-31 18:43:42,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51510, dest: /127.0.0.1:34578, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6508054468461277982_1338, duration: 6106694
2013-10-31 18:43:42,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,792 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44706, dest: /127.0.0.1:59471, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_6508054468461277982_1338, duration: 5212582
2013-10-31 18:43:42,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48596, dest: /127.0.0.1:37740, bytes: 16901, op: HDFS_WRITE, cliID: DFSClient_1872362589, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6508054468461277982_1338, duration: 4463352
2013-10-31 18:43:42,794 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6508054468461277982_1338 terminating
2013-10-31 18:43:42,800 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,800 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 from client DFSClient_1872362589
2013-10-31 18:43:42,801 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_logs/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 is closed by DFSClient_1872362589
2013-10-31 18:43:42,801 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,802 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6508054468461277982_1338 size 16901
2013-10-31 18:43:42,809 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0033_1383244991914_hadoop_%5B9E722C5C544D4F6E9EA520E87CC987CE%2F8E6D0FBB17654B29 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:42,810 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000000_0'
2013-10-31 18:43:42,810 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000001_0'
2013-10-31 18:43:42,810 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_m_000002_0'
2013-10-31 18:43:42,811 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:42,811 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0033_r_000000_0'
2013-10-31 18:43:42,812 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,812 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5135335180789234108 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,818 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,819 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,819 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5204921068052043086 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,819 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,819 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,820 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6329593982662489296 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:43:42,820 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:43:42,820 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:43:42,820 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1107095905103096836 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:43:42,837 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0033_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:43:42,851 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:42,851 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:42,851 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:42,851 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:42,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0033 dst=null perm=null
2013-10-31 18:43:42,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/9242968286_test_B67343406F2D4AD1A940E7BC2D2F16B2 dst=null perm=null
2013-10-31 18:43:42,978 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/_temporary
2013-10-31 18:43:42,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup dst=null perm=null
2013-10-31 18:43:42,997 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:42,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000 dst=null perm=null
2013-10-31 18:43:43,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000 dst=null perm=null
2013-10-31 18:43:43,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48600, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3315728293189659166_1337, duration: 279870
2013-10-31 18:43:43,003 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/groupgroup
2013-10-31 18:43:43,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup dst=null perm=null
2013-10-31 18:43:43,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/groupgroup/part-00000 dst=null perm=null
2013-10-31 18:43:43,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51513, bytes: 132, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3315728293189659166_1337, duration: 257490
2013-10-31 18:43:43,029 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:43:43,030 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:43:43,054 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] starting
2013-10-31 18:43:43,055 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"]
2013-10-31 18:43:43,055 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup"]
2013-10-31 18:43:43,055 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] parallel execution is enabled: true
2013-10-31 18:43:43,055 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] starting jobs: 2
2013-10-31 18:43:43,056 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [lower+upper+offset] allocating threads: 2
2013-10-31 18:43:43,057 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] starting step: (2/2)
2013-10-31 18:43:43,060 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:43:43,060 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:43:43,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:43,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:43:43,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,079 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar. blk_-4551812382357065300_1339
2013-10-31 18:43:43,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:51514 dest: /127.0.0.1:34578
2013-10-31 18:43:43,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:44712 dest: /127.0.0.1:59471
2013-10-31 18:43:43,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:48604 dest: /127.0.0.1:37740
2013-10-31 18:43:43,094 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48604, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4551812382357065300_1339, duration: 6599486
2013-10-31 18:43:43,094 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,094 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,094 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44712, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4551812382357065300_1339, duration: 7419260
2013-10-31 18:43:43,095 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,096 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51514, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4551812382357065300_1339, duration: 8539777
2013-10-31 18:43:43,096 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4551812382357065300_1339 terminating
2013-10-31 18:43:43,098 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,098 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar from client DFSClient_-1596270109
2013-10-31 18:43:43,099 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:43:43,099 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:43,104 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar. New replication is 10
2013-10-31 18:43:43,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=null
2013-10-31 18:43:43,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,118 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:43:43,123 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:43:43,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:43,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,140 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split. New replication is 10
2013-10-31 18:43:43,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:43,148 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split. blk_1454396135264491716_1340
2013-10-31 18:43:43,149 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:44714 dest: /127.0.0.1:59471
2013-10-31 18:43:43,151 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:48606 dest: /127.0.0.1:37740
2013-10-31 18:43:43,153 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:48890 dest: /127.0.0.1:54365
2013-10-31 18:43:43,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1454396135264491716_1340 src: /127.0.0.1:51520 dest: /127.0.0.1:34578
2013-10-31 18:43:43,158 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51520, dest: /127.0.0.1:34578, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 117442
2013-10-31 18:43:43,158 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,158 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48890, dest: /127.0.0.1:54365, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1454396135264491716_1340, duration: 930966
2013-10-31 18:43:43,159 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,159 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48606, dest: /127.0.0.1:37740, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1454396135264491716_1340, duration: 2088779
2013-10-31 18:43:43,160 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,160 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,160 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44714, dest: /127.0.0.1:59471, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1454396135264491716_1340, duration: 2891340
2013-10-31 18:43:43,161 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1454396135264491716_1340 terminating
2013-10-31 18:43:43,164 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,164 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split from client DFSClient_-1596270109
2013-10-31 18:43:43,165 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split is closed by DFSClient_-1596270109
2013-10-31 18:43:43,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,165 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1454396135264491716_1340 size 1732
2013-10-31 18:43:43,571 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-4551812382357065300_1339 to datanode(s) 127.0.0.1:54365
2013-10-31 18:43:43,572 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5135335180789234108_1336 blk_1107095905103096836_1328 blk_5794936352752417851_1333 blk_-2470905291057701022_1330 blk_-7533221922779966677_1331
2013-10-31 18:43:43,572 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_5135335180789234108_1336 blk_5204921068052043086_1329 blk_-6329593982662489296_1326
2013-10-31 18:43:43,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,634 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo. blk_-8305809994108552517_1341
2013-10-31 18:43:43,636 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:48609 dest: /127.0.0.1:37740
2013-10-31 18:43:43,637 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:48893 dest: /127.0.0.1:54365
2013-10-31 18:43:43,639 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8305809994108552517_1341 src: /127.0.0.1:51523 dest: /127.0.0.1:34578
2013-10-31 18:43:43,642 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51523, dest: /127.0.0.1:34578, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8305809994108552517_1341, duration: 66135
2013-10-31 18:43:43,642 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,642 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,643 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48893, dest: /127.0.0.1:54365, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8305809994108552517_1341, duration: 854426
2013-10-31 18:43:43,643 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,644 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48609, dest: /127.0.0.1:37740, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8305809994108552517_1341, duration: 1804089
2013-10-31 18:43:43,644 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8305809994108552517_1341 terminating
2013-10-31 18:43:43,644 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,647 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:43:43,647 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:43:43,647 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8305809994108552517_1341 size 183
2013-10-31 18:43:43,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,674 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml. blk_5164439424888837899_1342
2013-10-31 18:43:43,675 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:48895 dest: /127.0.0.1:54365
2013-10-31 18:43:43,677 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:48613 dest: /127.0.0.1:37740
2013-10-31 18:43:43,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5164439424888837899_1342 src: /127.0.0.1:44723 dest: /127.0.0.1:59471
2013-10-31 18:43:43,681 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44723, dest: /127.0.0.1:59471, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5164439424888837899_1342, duration: 215264
2013-10-31 18:43:43,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,682 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,682 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48613, dest: /127.0.0.1:37740, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5164439424888837899_1342, duration: 1039183
2013-10-31 18:43:43,683 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,683 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48895, dest: /127.0.0.1:54365, bytes: 28182, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 2114181
2013-10-31 18:43:43,684 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5164439424888837899_1342 terminating
2013-10-31 18:43:43,684 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,686 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml from client DFSClient_-1596270109
2013-10-31 18:43:43,687 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:43:43,687 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5164439424888837899_1342 size 28182
2013-10-31 18:43:43,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=null
2013-10-31 18:43:43,707 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48899, bytes: 28406, op: HDFS_READ, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 422992
2013-10-31 18:43:43,725 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0034: nMaps=5 nReduces=1 max=-1
2013-10-31 18:43:43,725 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0034 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:43:43,725 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0034
2013-10-31 18:43:43,726 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0034 RESULT=SUCCESS
2013-10-31 18:43:43,726 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0034
2013-10-31 18:43:43,727 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] submitted hadoop job: job_20131031182606197_0034
2013-10-31 18:43:43,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,759 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml. blk_7916561388913392372_1344
2013-10-31 18:43:43,760 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:48900 dest: /127.0.0.1:54365
2013-10-31 18:43:43,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:51530 dest: /127.0.0.1:34578
2013-10-31 18:43:43,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7916561388913392372_1344 src: /127.0.0.1:48619 dest: /127.0.0.1:37740
2013-10-31 18:43:43,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48619, dest: /127.0.0.1:37740, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7916561388913392372_1344, duration: 533200
2013-10-31 18:43:43,768 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,768 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51530, dest: /127.0.0.1:34578, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7916561388913392372_1344, duration: 1376942
2013-10-31 18:43:43,769 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,769 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48900, dest: /127.0.0.1:54365, bytes: 28247, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7916561388913392372_1344, duration: 2254969
2013-10-31 18:43:43,770 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7916561388913392372_1344 terminating
2013-10-31 18:43:43,773 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,773 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml from client DFSClient_2033320963
2013-10-31 18:43:43,774 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_conf.xml is closed by DFSClient_2033320963
2013-10-31 18:43:43,774 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,774 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7916561388913392372_1344 size 28247
2013-10-31 18:43:43,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:43:43,786 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken. blk_-4548667154538039926_1345
2013-10-31 18:43:43,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:48620 dest: /127.0.0.1:37740
2013-10-31 18:43:43,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:48904 dest: /127.0.0.1:54365
2013-10-31 18:43:43,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4548667154538039926_1345 src: /127.0.0.1:44731 dest: /127.0.0.1:59471
2013-10-31 18:43:43,794 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44731, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4548667154538039926_1345, duration: 91236
2013-10-31 18:43:43,794 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48904, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4548667154538039926_1345, duration: 954910
2013-10-31 18:43:43,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48620, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 1809353
2013-10-31 18:43:43,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,796 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4548667154538039926_1345 terminating
2013-10-31 18:43:43,798 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,799 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4548667154538039926_1345 size 116
2013-10-31 18:43:43,800 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken from client DFSClient_-1596270109
2013-10-31 18:43:43,800 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:43:43,805 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken
2013-10-31 18:43:43,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.splitmetainfo dst=null perm=null
2013-10-31 18:43:43,809 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48906, bytes: 187, op: HDFS_READ, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8305809994108552517_1341, duration: 279212
2013-10-31 18:43:43,811 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0034 = 19. Number of splits = 5
2013-10-31 18:43:43,811 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,811 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,812 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,813 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,814 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,815 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0034_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:43:43,815 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0034 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:43:43,815 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0034 initialized successfully with 5 map tasks and 1 reduce tasks.
2013-10-31 18:43:44,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data5/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:44,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data6/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:44,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data5/current/blk_-7533221922779966677
2013-10-31 18:43:44,983 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data5/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:44,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data6/current/blk_-2470905291057701022
2013-10-31 18:43:44,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data5/current/blk_1107095905103096836
2013-10-31 18:43:44,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data6/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:44,984 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5794936352752417851_1333 file build/test/data/dfs/data/data6/current/blk_5794936352752417851 for deletion
2013-10-31 18:43:44,985 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data6/current/blk_5135335180789234108
2013-10-31 18:43:44,985 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5794936352752417851_1333 at file build/test/data/dfs/data/data6/current/blk_5794936352752417851
2013-10-31 18:43:45,379 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-4551812382357065300_1339 to 127.0.0.1:54365
2013-10-31 18:43:45,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4551812382357065300_1339 src: /127.0.0.1:48908 dest: /127.0.0.1:54365
2013-10-31 18:43:45,382 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-4551812382357065300_1339 to /127.0.0.1:54365
2013-10-31 18:43:45,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-4551812382357065300_1339 src: /127.0.0.1:48908 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:43:45,388 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4551812382357065300_1339 size 238055
2013-10-31 18:43:45,452 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data7/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:45,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data7/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:45,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data7/current/blk_-6329593982662489296
2013-10-31 18:43:45,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data7/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:45,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data7/current/blk_5135335180789234108
2013-10-31 18:43:45,453 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data7/current/blk_5204921068052043086
2013-10-31 18:43:45,764 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0034_m_000006_0' to tip task_20131031182606197_0034_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:45,770 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:43:45,770 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000006_0 which needs 1 slots
2013-10-31 18:43:45,770 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:45,770 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000006_0 which needs 1 slots
2013-10-31 18:43:45,770 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0033 being deleted.
2013-10-31 18:43:45,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken dst=null perm=null
2013-10-31 18:43:45,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48626, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 421360
2013-10-31 18:43:45,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=null
2013-10-31 18:43:45,789 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48911, bytes: 28406, op: HDFS_READ, cliID: DFSClient_-2090601293, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 380164
2013-10-31 18:43:45,819 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:45,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=null
2013-10-31 18:43:45,845 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48912, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2090601293, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4551812382357065300_1339, duration: 1210442
2013-10-31 18:43:45,941 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:43:45,941 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_-950639163 spawned.
2013-10-31 18:43:45,944 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000006_0/taskjvm.sh
2013-10-31 18:43:46,573 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1107095905103096836_1328 blk_-2470905291057701022_1330 blk_5204921068052043086_1329 blk_-7533221922779966677_1331 blk_7520970391311344253_1332 blk_-6329593982662489296_1326
2013-10-31 18:43:46,573 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5135335180789234108_1336 blk_1107095905103096836_1328 blk_5204921068052043086_1329 blk_-6329593982662489296_1326
2013-10-31 18:43:47,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data3/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:47,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data3/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:47,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data3/current/blk_-6329593982662489296
2013-10-31 18:43:47,254 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5135335180789234108_1336 file build/test/data/dfs/data/data4/current/blk_5135335180789234108 for deletion
2013-10-31 18:43:47,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data3/current/blk_1107095905103096836
2013-10-31 18:43:47,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data4/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:47,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5135335180789234108_1336 at file build/test/data/dfs/data/data4/current/blk_5135335180789234108
2013-10-31 18:43:47,255 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data4/current/blk_5204921068052043086
2013-10-31 18:43:47,515 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-950639163 given task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:47,813 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0033
2013-10-31 18:43:47,813 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0033_m_000001_0 not found in cache
2013-10-31 18:43:47,813 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0033 for user-log deletion with retainTimeStamp:1383331427813
2013-10-31 18:43:47,827 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_r_103233333 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:47,832 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3642 with signal TERM. Exit code 0
2013-10-31 18:43:47,985 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:47,985 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:47,985 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:47,985 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_r_103233333 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:48,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:43:48,381 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-7533221922779966677_1331 file build/test/data/dfs/data/data1/current/blk_-7533221922779966677 for deletion
2013-10-31 18:43:48,381 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6329593982662489296_1326 file build/test/data/dfs/data/data1/current/blk_-6329593982662489296 for deletion
2013-10-31 18:43:48,381 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-7533221922779966677_1331 at file build/test/data/dfs/data/data1/current/blk_-7533221922779966677
2013-10-31 18:43:48,381 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2470905291057701022_1330 file build/test/data/dfs/data/data2/current/blk_-2470905291057701022 for deletion
2013-10-31 18:43:48,382 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6329593982662489296_1326 at file build/test/data/dfs/data/data1/current/blk_-6329593982662489296
2013-10-31 18:43:48,382 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1107095905103096836_1328 file build/test/data/dfs/data/data2/current/blk_1107095905103096836 for deletion
2013-10-31 18:43:48,382 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2470905291057701022_1330 at file build/test/data/dfs/data/data2/current/blk_-2470905291057701022
2013-10-31 18:43:48,382 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5204921068052043086_1329 file build/test/data/dfs/data/data1/current/blk_5204921068052043086 for deletion
2013-10-31 18:43:48,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1107095905103096836_1328 at file build/test/data/dfs/data/data2/current/blk_1107095905103096836
2013-10-31 18:43:48,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7520970391311344253_1332 file build/test/data/dfs/data/data2/current/blk_7520970391311344253 for deletion
2013-10-31 18:43:48,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5204921068052043086_1329 at file build/test/data/dfs/data/data1/current/blk_5204921068052043086
2013-10-31 18:43:48,383 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7520970391311344253_1332 at file build/test/data/dfs/data/data2/current/blk_7520970391311344253
2013-10-31 18:43:48,926 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_m_317850141 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:48,937 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3318 with signal TERM. Exit code 0
2013-10-31 18:43:49,100 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0033_m_1954828324 since job job_20131031182606197_0033 is dead
2013-10-31 18:43:49,111 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group3529 with signal TERM. Exit code 0
2013-10-31 18:43:49,152 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:49,152 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:49,152 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:49,152 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_m_317850141 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:43:49,336 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:43:49,336 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:43:49,336 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:43:49,336 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0033_m_1954828324 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:43:50,978 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000006_0 0.0% setup
2013-10-31 18:43:50,981 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000006_0 is done.
2013-10-31 18:43:50,982 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000006_0 was -1
2013-10-31 18:43:50,982 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:51,776 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000006_0' has completed task_20131031182606197_0034_m_000006 successfully.
2013-10-31 18:43:51,780 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000000_0' to tip task_20131031182606197_0034_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:51,781 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000000
2013-10-31 18:43:51,781 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000001_0' to tip task_20131031182606197_0034_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:51,782 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000001
2013-10-31 18:43:51,784 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:51,785 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:43:51,785 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000000_0 which needs 1 slots
2013-10-31 18:43:51,785 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000000_0 which needs 1 slots
2013-10-31 18:43:51,786 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000001_0 which needs 1 slots
2013-10-31 18:43:51,786 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0034_m_000001_0 which needs 1 slots
2013-10-31 18:43:51,820 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_-1745551915
2013-10-31 18:43:51,820 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_-1745551915 spawned.
2013-10-31 18:43:51,821 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000002_0' to tip task_20131031182606197_0034_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:51,821 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0034/attempt_20131031182606197_0034_m_000000_0. Attempting to reuse: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:43:51,821 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000002
2013-10-31 18:43:51,822 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000003_0' to tip task_20131031182606197_0034_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:43:51,822 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000003
2013-10-31 18:43:51,822 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000001_0/taskjvm.sh
2013-10-31 18:43:51,823 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:43:51,823 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:43:51,823 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000002_0 which needs 1 slots
2013-10-31 18:43:51,823 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000002_0 which needs 1 slots
2013-10-31 18:43:51,824 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000003_0 which needs 1 slots
2013-10-31 18:43:51,824 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0034_m_000003_0 which needs 1 slots
2013-10-31 18:43:51,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken dst=null perm=null
2013-10-31 18:43:51,827 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44741, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4548667154538039926_1345, duration: 142342
2013-10-31 18:43:51,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=null
2013-10-31 18:43:51,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48634, bytes: 28406, op: HDFS_READ, cliID: DFSClient_-106590138, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5164439424888837899_1342, duration: 161156
2013-10-31 18:43:51,852 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:51,859 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0034_m_000004_0' to tip task_20131031182606197_0034_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:43:51,860 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0034_m_000004
2013-10-31 18:43:51,861 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:43:51,861 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000004_0 which needs 1 slots
2013-10-31 18:43:51,862 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000004_0 which needs 1 slots
2013-10-31 18:43:51,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034/jobToken dst=null perm=null
2013-10-31 18:43:51,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48635, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4548667154538039926_1345, duration: 139179
2013-10-31 18:43:51,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.xml dst=null perm=null
2013-10-31 18:43:51,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48920, bytes: 28406, op: HDFS_READ, cliID: DFSClient_23976491, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5164439424888837899_1342, duration: 158098
2013-10-31 18:43:51,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=null
2013-10-31 18:43:51,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48638, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-106590138, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4551812382357065300_1339, duration: 611620
2013-10-31 18:43:51,902 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:43:51,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.jar dst=null perm=null
2013-10-31 18:43:51,916 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48922, bytes: 239915, op: HDFS_READ, cliID: DFSClient_23976491, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4551812382357065300_1339, duration: 587547
2013-10-31 18:43:51,944 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_921467046
2013-10-31 18:43:51,945 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_921467046 spawned.
2013-10-31 18:43:51,945 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_1100073729
2013-10-31 18:43:51,946 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_1100073729 spawned.
2013-10-31 18:43:51,947 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000003_0/taskjvm.sh
2013-10-31 18:43:51,947 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000002_0/taskjvm.sh
2013-10-31 18:43:51,969 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_m_1359958609
2013-10-31 18:43:51,969 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_m_1359958609 spawned.
2013-10-31 18:43:51,970 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_m_000004_0/taskjvm.sh
2013-10-31 18:43:52,045 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-950639163 given task: attempt_20131031182606197_0034_m_000000_0
2013-10-31 18:43:52,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:52,165 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44750, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1454396135264491716_1340, duration: 171281
2013-10-31 18:43:52,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:52,493 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48925, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 292363
2013-10-31 18:43:53,933 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-1745551915 given task: attempt_20131031182606197_0034_m_000001_0
2013-10-31 18:43:53,968 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_921467046 given task: attempt_20131031182606197_0034_m_000003_0
2013-10-31 18:43:53,980 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_1100073729 given task: attempt_20131031182606197_0034_m_000002_0
2013-10-31 18:43:54,011 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_1359958609 given task: attempt_20131031182606197_0034_m_000004_0
2013-10-31 18:43:54,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:54,447 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51561, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 168081
2013-10-31 18:43:54,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:54,470 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48934, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000003_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1454396135264491716_1340, duration: 223464
2013-10-31 18:43:54,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:54,486 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48652, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 111967
2013-10-31 18:43:54,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:54,511 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44763, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 140861
2013-10-31 18:43:54,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:54,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48655, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000004_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1454396135264491716_1340, duration: 208068
2013-10-31 18:43:54,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:54,573 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48939, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 170311
2013-10-31 18:43:54,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034/job.split dst=null perm=null
2013-10-31 18:43:54,581 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51569, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000002_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1454396135264491716_1340, duration: 140307
2013-10-31 18:43:54,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:43:54,623 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:48942, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0034_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 137870
2013-10-31 18:43:55,129 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+4
2013-10-31 18:43:55,133 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000000_0 is done.
2013-10-31 18:43:55,133 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000000_0 was 40
2013-10-31 18:43:55,134 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:43:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:43:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,022 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,038 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,043 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:43:56,043 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:43:56,785 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:56,786 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0034_m_000006_0
2013-10-31 18:43:56,786 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0034_m_000006_0 not found in cache
2013-10-31 18:43:57,377 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:4+4
2013-10-31 18:43:57,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000001_0 is done.
2013-10-31 18:43:57,380 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000001_0 was 40
2013-10-31 18:43:57,380 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,401 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:12+4
2013-10-31 18:43:57,403 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000003_0 is done.
2013-10-31 18:43:57,403 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000003_0 was 40
2013-10-31 18:43:57,404 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:43:57,462 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:16+3
2013-10-31 18:43:57,464 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000004_0 is done.
2013-10-31 18:43:57,465 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000004_0 was 40
2013-10-31 18:43:57,465 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,511 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:8+4
2013-10-31 18:43:57,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000002_0 is done.
2013-10-31 18:43:57,513 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000002_0 was 40
2013-10-31 18:43:57,514 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:43:57,789 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000000_0' has completed task_20131031182606197_0034_m_000000 successfully.
2013-10-31 18:43:57,790 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000001_0' has completed task_20131031182606197_0034_m_000001 successfully.
2013-10-31 18:43:57,792 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0034_r_000000_0' to tip task_20131031182606197_0034_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:43:57,795 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:43:57,795 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_r_000000_0 which needs 1 slots
2013-10-31 18:43:57,795 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_r_000000_0 which needs 1 slots
2013-10-31 18:43:57,829 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000002_0' has completed task_20131031182606197_0034_m_000002 successfully.
2013-10-31 18:43:57,831 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000003_0' has completed task_20131031182606197_0034_m_000003 successfully.
2013-10-31 18:43:57,833 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0034_r_-710253377
2013-10-31 18:43:57,834 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0034_r_-710253377 spawned.
2013-10-31 18:43:57,838 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0034/attempt_20131031182606197_0034_r_000000_0/taskjvm.sh
2013-10-31 18:43:57,866 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000004_0' has completed task_20131031182606197_0034_m_000004 successfully.
2013-10-31 18:43:58,672 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_r_-710253377 given task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:04,376 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40955, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000000_0, duration: 7426341
2013-10-31 18:44:04,397 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:40955, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000001_0, duration: 8284013
2013-10-31 18:44:04,414 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42977, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000002_0, duration: 12365338
2013-10-31 18:44:04,429 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:42977, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000003_0, duration: 11332046
2013-10-31 18:44:04,446 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50612, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0034_m_000004_0, duration: 11917580
2013-10-31 18:44:05,164 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,238 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,291 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:05,476 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1809 Total time for transactions(ms): 33Number of transactions batched in Syncs: 149 Number of syncs: 1271 SyncTimes(ms): 78497 18156
2013-10-31 18:44:05,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:05,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:05,520 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000. blk_5157468367762981491_1346
2013-10-31 18:44:05,548 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:48665 dest: /127.0.0.1:37740
2013-10-31 18:44:05,550 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:51578 dest: /127.0.0.1:34578
2013-10-31 18:44:05,551 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5157468367762981491_1346 src: /127.0.0.1:44776 dest: /127.0.0.1:59471
2013-10-31 18:44:05,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44776, dest: /127.0.0.1:59471, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5157468367762981491_1346, duration: 2000999
2013-10-31 18:44:05,555 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,555 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,555 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51578, dest: /127.0.0.1:34578, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5157468367762981491_1346, duration: 2686587
2013-10-31 18:44:05,556 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,556 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,556 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48665, dest: /127.0.0.1:37740, bytes: 290, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0034_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5157468367762981491_1346, duration: 3240459
2013-10-31 18:44:05,556 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5157468367762981491_1346 terminating
2013-10-31 18:44:05,559 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:05,559 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:05,559 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5157468367762981491_1346 size 290
2013-10-31 18:44:05,595 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0034_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:44:05,596 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 0.33333334% reduce > copy (5 of 5 at 0.00 MB/s)
2013-10-31 18:44:06,805 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 5 OK for attempt_20131031182606197_0034_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:44:06,806 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:07,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0 dst=null perm=null
2013-10-31 18:44:07,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:07,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:07,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary/_attempt_20131031182606197_0034_r_000000_0 dst=null perm=null
2013-10-31 18:44:08,212 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:08,214 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:08,215 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_r_000000_0 is done.
2013-10-31 18:44:08,215 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_r_000000_0 was -1
2013-10-31 18:44:08,216 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:09,482 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7711436382493962850_1126
2013-10-31 18:44:09,810 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_r_000000_0' has completed task_20131031182606197_0034_r_000000 successfully.
2013-10-31 18:44:09,813 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0034_m_000005_0' to tip task_20131031182606197_0034_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:09,815 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0034_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:09,816 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0034_m_000005_0 which needs 1 slots
2013-10-31 18:44:09,816 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0034_m_000005_0 which needs 1 slots
2013-10-31 18:44:09,854 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0034/attempt_20131031182606197_0034_m_000005_0. Attempting to reuse: jvm_20131031182606197_0034_m_-1745551915
2013-10-31 18:44:10,168 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0034_m_-1745551915 given task: attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,300 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000005_0 0.0%
2013-10-31 18:44:10,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_temporary dst=null perm=null
2013-10-31 18:44:10,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:10,319 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS from client DFSClient_attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,319 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0034_m_000005_0
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4551812382357065300 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1454396135264491716 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:10,324 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,325 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8305809994108552517 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,325 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:10,325 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:10,325 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5164439424888837899 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:10,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0034 dst=null perm=null
2013-10-31 18:44:10,484 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-4203961431443320417_1020
2013-10-31 18:44:10,577 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_1454396135264491716_1340
2013-10-31 18:44:10,578 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:12,003 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 94 raw values into 1 aggregated values, total 16
2013-10-31 18:44:12,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data1/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:12,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data1/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:12,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data1/current/blk_-8305809994108552517
2013-10-31 18:44:12,389 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data2/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:12,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data1/current/blk_-4551812382357065300
2013-10-31 18:44:12,390 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data2/current/blk_1454396135264491716
2013-10-31 18:44:12,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data8/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:12,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data8/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:12,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data8/current/blk_-8305809994108552517
2013-10-31 18:44:12,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data7/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:12,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data8/current/blk_-4551812382357065300
2013-10-31 18:44:12,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data7/current/blk_1454396135264491716
2013-10-31 18:44:12,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data7/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:12,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data7/current/blk_5164439424888837899
2013-10-31 18:44:13,249 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0034_m_000005_0 0.0% cleanup
2013-10-31 18:44:13,250 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0034_m_000005_0 is done.
2013-10-31 18:44:13,251 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0034_m_000005_0 was -1
2013-10-31 18:44:13,251 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:13,578 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4551812382357065300_1339 blk_-8305809994108552517_1341 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:13,578 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4551812382357065300_1339 blk_5164439424888837899_1342 blk_1454396135264491716_1340
2013-10-31 18:44:14,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8305809994108552517_1341 file build/test/data/dfs/data/data3/current/blk_-8305809994108552517 for deletion
2013-10-31 18:44:14,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data3/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:14,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8305809994108552517_1341 at file build/test/data/dfs/data/data3/current/blk_-8305809994108552517
2013-10-31 18:44:14,264 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data4/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:14,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data3/current/blk_-4551812382357065300
2013-10-31 18:44:14,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data4/current/blk_1454396135264491716
2013-10-31 18:44:14,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data4/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:14,266 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data4/current/blk_5164439424888837899
2013-10-31 18:44:14,816 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:14,816 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0034_r_000000_0
2013-10-31 18:44:14,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4551812382357065300_1339 file build/test/data/dfs/data/data6/current/blk_-4551812382357065300 for deletion
2013-10-31 18:44:14,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1454396135264491716_1340 file build/test/data/dfs/data/data5/current/blk_1454396135264491716 for deletion
2013-10-31 18:44:14,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4551812382357065300_1339 at file build/test/data/dfs/data/data6/current/blk_-4551812382357065300
2013-10-31 18:44:14,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1454396135264491716_1340 at file build/test/data/dfs/data/data5/current/blk_1454396135264491716
2013-10-31 18:44:14,993 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5164439424888837899_1342 file build/test/data/dfs/data/data6/current/blk_5164439424888837899 for deletion
2013-10-31 18:44:14,994 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5164439424888837899_1342 at file build/test/data/dfs/data/data6/current/blk_5164439424888837899
2013-10-31 18:44:15,823 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0034_m_000005_0' has completed task_20131031182606197_0034_m_000005 successfully.
2013-10-31 18:44:15,824 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0034 has completed successfully.
2013-10-31 18:44:15,824 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0034,submitTime=1383245023693,launchTime=1383245023815,firstMapTaskLaunchTime=1383245031779,firstReduceTaskLaunchTime=1383245037792,firstJobSetupTaskLaunchTime=1383245025763,firstJobCleanupTaskLaunchTime=1383245049812,finishTime=1383245055824,numMaps=5,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=34,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[CE7497985D0148D183840F8CF65154C9/3EE2A0E4707244D4AD91EAD51ADE1822] lower+upper+offset/(2/2)
2013-10-31 18:44:15,829 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4. blk_-5199617541030467941_1347
2013-10-31 18:44:15,831 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:48671 dest: /127.0.0.1:37740
2013-10-31 18:44:15,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:44781 dest: /127.0.0.1:59471
2013-10-31 18:44:15,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5199617541030467941_1347 src: /127.0.0.1:48956 dest: /127.0.0.1:54365
2013-10-31 18:44:15,842 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48956, dest: /127.0.0.1:54365, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5199617541030467941_1347, duration: 4270997
2013-10-31 18:44:15,843 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,843 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44781, dest: /127.0.0.1:59471, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5199617541030467941_1347, duration: 5734869
2013-10-31 18:44:15,845 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,845 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,845 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48671, dest: /127.0.0.1:37740, bytes: 32004, op: HDFS_WRITE, cliID: DFSClient_2033320963, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5199617541030467941_1347, duration: 7467963
2013-10-31 18:44:15,846 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,846 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5199617541030467941_1347 terminating
2013-10-31 18:44:15,849 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 from client DFSClient_2033320963
2013-10-31 18:44:15,849 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/_logs/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 is closed by DFSClient_2033320963
2013-10-31 18:44:15,849 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5199617541030467941_1347 size 32004
2013-10-31 18:44:15,855 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0034_1383245023693_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2F3EE2A0E4707244D4 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:15,855 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000000_0'
2013-10-31 18:44:15,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000001_0'
2013-10-31 18:44:15,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000005_0'
2013-10-31 18:44:15,856 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000006_0'
2013-10-31 18:44:15,857 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_r_000000_0'
2013-10-31 18:44:15,857 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:15,857 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:15,857 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4548667154538039926 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:15,857 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000002_0'
2013-10-31 18:44:15,858 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000003_0'
2013-10-31 18:44:15,861 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0034_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:15,861 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] starting step: (1/2) .../samemergethreechaingroup
2013-10-31 18:44:15,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0034 dst=null perm=null
2013-10-31 18:44:15,866 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:44:15,866 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:44:15,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:15,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:44:15,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,887 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar. blk_-9197354684127990610_1348
2013-10-31 18:44:15,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:51587 dest: /127.0.0.1:34578
2013-10-31 18:44:15,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:44785 dest: /127.0.0.1:59471
2013-10-31 18:44:15,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:48677 dest: /127.0.0.1:37740
2013-10-31 18:44:15,894 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48677, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9197354684127990610_1348, duration: 3300778
2013-10-31 18:44:15,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44785, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9197354684127990610_1348, duration: 2854036
2013-10-31 18:44:15,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,895 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51587, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9197354684127990610_1348, duration: 3810611
2013-10-31 18:44:15,895 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9197354684127990610_1348 terminating
2013-10-31 18:44:15,897 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,897 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar from client DFSClient_-1596270109
2013-10-31 18:44:15,898 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:44:15,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,898 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:15,903 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar. New replication is 10
2013-10-31 18:44:15,906 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0034_m_000004_0'
2013-10-31 18:44:15,907 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:15,907 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0034 being deleted.
2013-10-31 18:44:15,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=null
2013-10-31 18:44:15,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,917 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:44:15,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1 dst=null perm=null
2013-10-31 18:44:15,921 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000 dst=null perm=null
2013-10-31 18:44:15,923 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:15,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1 dst=null perm=null
2013-10-31 18:44:15,926 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000 dst=null perm=null
2013-10-31 18:44:15,928 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:15,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:15,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,940 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split. New replication is 10
2013-10-31 18:44:15,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:15,946 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split. blk_-3425796593221907686_1349
2013-10-31 18:44:15,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:51590 dest: /127.0.0.1:34578
2013-10-31 18:44:15,948 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:48679 dest: /127.0.0.1:37740
2013-10-31 18:44:15,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:48963 dest: /127.0.0.1:54365
2013-10-31 18:44:15,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-3425796593221907686_1349 src: /127.0.0.1:44790 dest: /127.0.0.1:59471
2013-10-31 18:44:15,953 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44790, dest: /127.0.0.1:59471, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 1136598
2013-10-31 18:44:15,953 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,953 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48963, dest: /127.0.0.1:54365, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 333402
2013-10-31 18:44:15,954 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,954 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,954 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48679, dest: /127.0.0.1:37740, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-3425796593221907686_1349, duration: 1047666
2013-10-31 18:44:15,954 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,955 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,955 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51590, dest: /127.0.0.1:34578, bytes: 2083, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 2216818
2013-10-31 18:44:15,955 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-3425796593221907686_1349 terminating
2013-10-31 18:44:15,957 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split from client DFSClient_-1596270109
2013-10-31 18:44:15,957 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split is closed by DFSClient_-1596270109
2013-10-31 18:44:15,958 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,959 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-3425796593221907686_1349 size 2083
2013-10-31 18:44:15,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:15,976 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo. blk_1024870396640826331_1350
2013-10-31 18:44:15,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:44791 dest: /127.0.0.1:59471
2013-10-31 18:44:15,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:51595 dest: /127.0.0.1:34578
2013-10-31 18:44:15,980 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1024870396640826331_1350 src: /127.0.0.1:48684 dest: /127.0.0.1:37740
2013-10-31 18:44:15,986 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48684, dest: /127.0.0.1:37740, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1024870396640826331_1350, duration: 3463511
2013-10-31 18:44:15,987 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,987 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51595, dest: /127.0.0.1:34578, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1024870396640826331_1350, duration: 913609
2013-10-31 18:44:15,988 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,988 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44791, dest: /127.0.0.1:59471, bytes: 220, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1024870396640826331_1350, duration: 1734247
2013-10-31 18:44:15,989 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1024870396640826331_1350 terminating
2013-10-31 18:44:15,991 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:15,992 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:15,993 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1024870396640826331_1350 size 220
2013-10-31 18:44:16,391 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:44:16,392 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:44:16,579 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:37740 to replicate blk_-9197354684127990610_1348 to datanode(s) 127.0.0.1:54365
2013-10-31 18:44:16,580 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-4548667154538039926_1345
2013-10-31 18:44:16,580 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-4548667154538039926_1345
2013-10-31 18:44:16,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:16,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:16,903 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml. blk_3611869011102150252_1351
2013-10-31 18:44:16,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:51597 dest: /127.0.0.1:34578
2013-10-31 18:44:16,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:48686 dest: /127.0.0.1:37740
2013-10-31 18:44:16,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3611869011102150252_1351 src: /127.0.0.1:44796 dest: /127.0.0.1:59471
2013-10-31 18:44:16,911 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44796, dest: /127.0.0.1:59471, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3611869011102150252_1351, duration: 374655
2013-10-31 18:44:16,912 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,912 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48686, dest: /127.0.0.1:37740, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3611869011102150252_1351, duration: 1247502
2013-10-31 18:44:16,913 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,913 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51597, dest: /127.0.0.1:34578, bytes: 28710, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 2224789
2013-10-31 18:44:16,914 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3611869011102150252_1351 terminating
2013-10-31 18:44:16,918 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,919 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml from client DFSClient_-1596270109
2013-10-31 18:44:16,919 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:44:16,919 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,920 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3611869011102150252_1351 size 28710
2013-10-31 18:44:16,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=null
2013-10-31 18:44:16,951 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51601, bytes: 28938, op: HDFS_READ, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 453087
2013-10-31 18:44:16,971 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0035: nMaps=6 nReduces=1 max=-1
2013-10-31 18:44:16,972 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0035 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:44:16,972 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0035
2013-10-31 18:44:16,972 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0035 RESULT=SUCCESS
2013-10-31 18:44:16,972 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0035
2013-10-31 18:44:16,973 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [lower+upper+offset] submitted hadoop job: job_20131031182606197_0035
2013-10-31 18:44:16,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,006 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml. blk_-8586261772825454961_1353
2013-10-31 18:44:17,008 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:44799 dest: /127.0.0.1:59471
2013-10-31 18:44:17,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:48974 dest: /127.0.0.1:54365
2013-10-31 18:44:17,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8586261772825454961_1353 src: /127.0.0.1:48692 dest: /127.0.0.1:37740
2013-10-31 18:44:17,015 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48692, dest: /127.0.0.1:37740, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8586261772825454961_1353, duration: 464924
2013-10-31 18:44:17,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,016 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48974, dest: /127.0.0.1:54365, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8586261772825454961_1353, duration: 1931525
2013-10-31 18:44:17,016 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,017 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44799, dest: /127.0.0.1:59471, bytes: 28775, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8586261772825454961_1353, duration: 2200194
2013-10-31 18:44:17,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8586261772825454961_1353 terminating
2013-10-31 18:44:17,021 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,022 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml from client DFSClient_-858444681
2013-10-31 18:44:17,022 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_conf.xml is closed by DFSClient_-858444681
2013-10-31 18:44:17,022 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,023 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8586261772825454961_1353 size 28775
2013-10-31 18:44:17,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:17,036 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken. blk_-8829734083624927549_1354
2013-10-31 18:44:17,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:48693 dest: /127.0.0.1:37740
2013-10-31 18:44:17,039 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:44803 dest: /127.0.0.1:59471
2013-10-31 18:44:17,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8829734083624927549_1354 src: /127.0.0.1:51607 dest: /127.0.0.1:34578
2013-10-31 18:44:17,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51607, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 71660
2013-10-31 18:44:17,044 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,044 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44803, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8829734083624927549_1354, duration: 875780
2013-10-31 18:44:17,045 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,045 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48693, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8829734083624927549_1354, duration: 1773854
2013-10-31 18:44:17,046 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8829734083624927549_1354 terminating
2013-10-31 18:44:17,046 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8829734083624927549_1354 size 116
2013-10-31 18:44:17,048 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken from client DFSClient_-1596270109
2013-10-31 18:44:17,049 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:44:17,054 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken
2013-10-31 18:44:17,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.splitmetainfo dst=null perm=null
2013-10-31 18:44:17,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51608, bytes: 224, op: HDFS_READ, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1024870396640826331_1350, duration: 273284
2013-10-31 18:44:17,060 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0035 = 309. Number of splits = 6
2013-10-31 18:44:17,060 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,061 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,062 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,063 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,064 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0035_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:17,065 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0035 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:44:17,065 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0035 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:44:17,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data4/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:17,265 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data4/current/blk_-4548667154538039926
2013-10-31 18:44:18,463 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555) Starting thread to transfer block blk_-9197354684127990610_1348 to 127.0.0.1:54365
2013-10-31 18:44:18,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data7/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:18,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data7/current/blk_-4548667154538039926
2013-10-31 18:44:18,466 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9197354684127990610_1348 src: /127.0.0.1:48980 dest: /127.0.0.1:54365
2013-10-31 18:44:18,466 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:37740, storageID=DS-1799801127-10.5.128.102-37740-1383243966037, infoPort=55697, ipcPort=35555):Transmitted block blk_-9197354684127990610_1348 to /127.0.0.1:54365
2013-10-31 18:44:18,469 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-9197354684127990610_1348 src: /127.0.0.1:48980 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:44:18,470 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9197354684127990610_1348 size 238055
2013-10-31 18:44:18,861 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0035_m_000007_0' to tip task_20131031182606197_0035_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:18,869 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:44:18,869 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000007_0 which needs 1 slots
2013-10-31 18:44:18,869 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000007_0 which needs 1 slots
2013-10-31 18:44:18,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken dst=null perm=null
2013-10-31 18:44:18,878 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44807, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8829734083624927549_1354, duration: 292061
2013-10-31 18:44:18,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=null
2013-10-31 18:44:18,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51612, bytes: 28938, op: HDFS_READ, cliID: DFSClient_1057907758, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 378925
2013-10-31 18:44:18,918 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:18,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=null
2013-10-31 18:44:18,946 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51613, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1057907758, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9197354684127990610_1348, duration: 1184455
2013-10-31 18:44:19,041 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0034_m_-950639163
2013-10-31 18:44:19,048 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4093 with signal TERM. Exit code 0
2013-10-31 18:44:19,048 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:19,049 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1380072797 spawned.
2013-10-31 18:44:19,050 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000007_0/taskjvm.sh
2013-10-31 18:44:19,581 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-4548667154538039926_1345
2013-10-31 18:44:19,643 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:19,644 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:19,644 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:19,644 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_-950639163 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:44:20,380 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:20,487 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7295626289958709819_1037
2013-10-31 18:44:20,857 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,857 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0034_m_000005_0 not found in cache
2013-10-31 18:44:20,858 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460858
2013-10-31 18:44:20,858 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,859 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460859
2013-10-31 18:44:20,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:20,907 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0034
2013-10-31 18:44:20,908 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0034 for user-log deletion with retainTimeStamp:1383331460908
2013-10-31 18:44:20,995 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4548667154538039926_1345 file build/test/data/dfs/data/data5/current/blk_-4548667154538039926 for deletion
2013-10-31 18:44:20,995 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4548667154538039926_1345 at file build/test/data/dfs/data/data5/current/blk_-4548667154538039926
2013-10-31 18:44:21,372 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_-1745551915 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:21,383 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4252 with signal TERM. Exit code 0
2013-10-31 18:44:21,559 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:21,559 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:21,559 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:21,559 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_-1745551915 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:44:22,206 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_1100073729 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,216 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_1359958609 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,216 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4254 with signal TERM. Exit code 0
2013-10-31 18:44:22,218 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_m_921467046 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,227 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4253 with signal TERM. Exit code 0
2013-10-31 18:44:22,228 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4255 with signal TERM. Exit code 0
2013-10-31 18:44:22,254 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0034_r_-710253377 since job job_20131031182606197_0034 is dead
2013-10-31 18:44:22,264 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4501 with signal TERM. Exit code 0
2013-10-31 18:44:22,414 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,415 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,415 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:22,415 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_r_-710253377 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,453 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,453 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,453 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:22,453 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,453 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,453 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:22,453 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_1359958609 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,453 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_921467046 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:22,454 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:22,454 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:22,454 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:22,454 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0034_m_1100073729 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:23,832 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000007_0 0.0% setup
2013-10-31 18:44:23,835 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000007_0 is done.
2013-10-31 18:44:23,835 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000007_0 was -1
2013-10-31 18:44:23,836 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:24,875 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000007_0' has completed task_20131031182606197_0035_m_000007 successfully.
2013-10-31 18:44:24,878 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000000_0' to tip task_20131031182606197_0035_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:24,879 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000000
2013-10-31 18:44:24,880 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000001_0' to tip task_20131031182606197_0035_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:24,880 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000001
2013-10-31 18:44:24,882 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:24,883 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:44:24,884 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000000_0 which needs 1 slots
2013-10-31 18:44:24,884 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000000_0 which needs 1 slots
2013-10-31 18:44:24,884 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000001_0 which needs 1 slots
2013-10-31 18:44:24,885 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000001_0 which needs 1 slots
2013-10-31 18:44:24,917 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000002_0' to tip task_20131031182606197_0035_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:24,917 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000002
2013-10-31 18:44:24,918 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000003_0' to tip task_20131031182606197_0035_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:24,918 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000003
2013-10-31 18:44:24,918 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000004_0' to tip task_20131031182606197_0035_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:24,919 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000004
2013-10-31 18:44:24,919 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:44:24,919 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_781049111
2013-10-31 18:44:24,920 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:44:24,919 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0035_m_000005_0' to tip task_20131031182606197_0035_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:24,920 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_781049111 spawned.
2013-10-31 18:44:24,921 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0035_m_000005
2013-10-31 18:44:24,921 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000002_0 which needs 1 slots
2013-10-31 18:44:24,922 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0035/attempt_20131031182606197_0035_m_000000_0. Attempting to reuse: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:24,922 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000002_0 which needs 1 slots
2013-10-31 18:44:24,923 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:44:24,923 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000003_0 which needs 1 slots
2013-10-31 18:44:24,924 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:24,924 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000003_0 which needs 1 slots
2013-10-31 18:44:24,924 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000004_0 which needs 1 slots
2013-10-31 18:44:24,925 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000004_0 which needs 1 slots
2013-10-31 18:44:24,926 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000005_0 which needs 1 slots
2013-10-31 18:44:24,926 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000001_0/taskjvm.sh
2013-10-31 18:44:24,926 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0035_m_000005_0 which needs 1 slots
2013-10-31 18:44:24,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken dst=null perm=null
2013-10-31 18:44:24,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035/jobToken dst=null perm=null
2013-10-31 18:44:24,930 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51616, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 308055
2013-10-31 18:44:24,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51617, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8829734083624927549_1354, duration: 546107
2013-10-31 18:44:24,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=null
2013-10-31 18:44:24,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.xml dst=null perm=null
2013-10-31 18:44:24,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44817, bytes: 28938, op: HDFS_READ, cliID: DFSClient_2035508770, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3611869011102150252_1351, duration: 440885
2013-10-31 18:44:24,941 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51621, bytes: 28938, op: HDFS_READ, cliID: DFSClient_881113897, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3611869011102150252_1351, duration: 389797
2013-10-31 18:44:24,961 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:24,967 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:24,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=null
2013-10-31 18:44:24,978 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44819, bytes: 239915, op: HDFS_READ, cliID: DFSClient_881113897, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9197354684127990610_1348, duration: 598023
2013-10-31 18:44:25,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.jar dst=null perm=null
2013-10-31 18:44:25,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48711, bytes: 239915, op: HDFS_READ, cliID: DFSClient_2035508770, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9197354684127990610_1348, duration: 1658351
2013-10-31 18:44:25,213 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_18439869
2013-10-31 18:44:25,214 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_18439869 spawned.
2013-10-31 18:44:25,214 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1186787883
2013-10-31 18:44:25,215 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1186787883 spawned.
2013-10-31 18:44:25,223 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000005_0/taskjvm.sh
2013-10-31 18:44:25,224 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000004_0/taskjvm.sh
2013-10-31 18:44:25,234 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_-1752732000
2013-10-31 18:44:25,235 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_-1752732000 spawned.
2013-10-31 18:44:25,236 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000002_0/taskjvm.sh
2013-10-31 18:44:25,237 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_m_1866653766
2013-10-31 18:44:25,238 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_m_1866653766 spawned.
2013-10-31 18:44:25,239 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_m_000003_0/taskjvm.sh
2013-10-31 18:44:25,391 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000000_0
2013-10-31 18:44:25,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:25,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44822, bytes: 2103, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 357838
2013-10-31 18:44:25,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000 dst=null perm=null
2013-10-31 18:44:25,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48714, bytes: 294, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5157468367762981491_1346, duration: 256267
2013-10-31 18:44:26,742 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_781049111 given task: attempt_20131031182606197_0035_m_000001_0
2013-10-31 18:44:27,242 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_1866653766 given task: attempt_20131031182606197_0035_m_000003_0
2013-10-31 18:44:27,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:27,249 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51633, bytes: 2103, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 165309
2013-10-31 18:44:27,256 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1752732000 given task: attempt_20131031182606197_0035_m_000002_0
2013-10-31 18:44:27,265 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1186787883 given task: attempt_20131031182606197_0035_m_000004_0
2013-10-31 18:44:27,271 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_18439869 given task: attempt_20131031182606197_0035_m_000005_0
2013-10-31 18:44:27,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:27,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44831, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 174539
2013-10-31 18:44:27,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:27,762 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51639, bytes: 1071, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-3425796593221907686_1349, duration: 170645
2013-10-31 18:44:27,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:27,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:27,772 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44837, bytes: 555, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-3425796593221907686_1349, duration: 141061
2013-10-31 18:44:27,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49012, bytes: 1587, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 139219
2013-10-31 18:44:27,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:27,801 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44839, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 109216
2013-10-31 18:44:27,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035/job.split dst=null perm=null
2013-10-31 18:44:27,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:27,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:27,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44840, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000005_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 111796
2013-10-31 18:44:27,814 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49015, bytes: 1071, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000004_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-3425796593221907686_1349, duration: 726269
2013-10-31 18:44:27,814 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44842, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 1103677
2013-10-31 18:44:27,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:44:27,852 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49017, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0035_m_000004_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 113985
2013-10-31 18:44:28,471 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1/part-00000:0+290
2013-10-31 18:44:28,474 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000000_0 is done.
2013-10-31 18:44:28,474 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000000_0 was 176
2013-10-31 18:44:28,474 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:29,884 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:29,884 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0035_m_000007_0
2013-10-31 18:44:29,884 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0035_m_000007_0 not found in cache
2013-10-31 18:44:30,178 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+4
2013-10-31 18:44:30,180 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000001_0 is done.
2013-10-31 18:44:30,180 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000001_0 was 23
2013-10-31 18:44:30,181 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,681 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:8+4
2013-10-31 18:44:30,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000003_0 is done.
2013-10-31 18:44:30,684 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000003_0 was 23
2013-10-31 18:44:30,684 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:30,701 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000005_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:16+3
2013-10-31 18:44:30,702 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:4+4
2013-10-31 18:44:30,703 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000005_0 is done.
2013-10-31 18:44:30,703 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000005_0 was 23
2013-10-31 18:44:30,703 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:44:30,704 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000002_0 is done.
2013-10-31 18:44:30,704 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000002_0 was 23
2013-10-31 18:44:30,704 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,739 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000004_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:12+4
2013-10-31 18:44:30,741 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000004_0 is done.
2013-10-31 18:44:30,741 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000004_0 was 23
2013-10-31 18:44:30,741 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:30,887 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000000_0' has completed task_20131031182606197_0035_m_000000 successfully.
2013-10-31 18:44:31,529 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000001_0' has completed task_20131031182606197_0035_m_000001 successfully.
2013-10-31 18:44:31,531 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0035_r_000000_0' to tip task_20131031182606197_0035_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:31,532 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000004_0' has completed task_20131031182606197_0035_m_000004 successfully.
2013-10-31 18:44:31,534 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:31,534 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_r_000000_0 which needs 1 slots
2013-10-31 18:44:31,535 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000005_0' has completed task_20131031182606197_0035_m_000005 successfully.
2013-10-31 18:44:31,535 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_r_000000_0 which needs 1 slots
2013-10-31 18:44:31,539 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000002_0' has completed task_20131031182606197_0035_m_000002 successfully.
2013-10-31 18:44:31,540 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000003_0' has completed task_20131031182606197_0035_m_000003 successfully.
2013-10-31 18:44:31,572 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0035_r_1908169258
2013-10-31 18:44:31,574 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0035_r_1908169258 spawned.
2013-10-31 18:44:31,577 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0035/attempt_20131031182606197_0035_r_000000_0/taskjvm.sh
2013-10-31 18:44:32,400 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_r_1908169258 given task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:38,079 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41033, bytes: 176, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000000_0, duration: 7696417
2013-10-31 18:44:38,093 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41033, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000001_0, duration: 7992580
2013-10-31 18:44:38,109 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45731, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000004_0, duration: 12434451
2013-10-31 18:44:38,124 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:45731, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000005_0, duration: 11240125
2013-10-31 18:44:38,141 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50690, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000002_0, duration: 11673322
2013-10-31 18:44:38,156 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:50690, bytes: 23, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0035_m_000003_0, duration: 11434477
2013-10-31 18:44:38,865 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:38,938 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:38,992 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:39,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:39,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:39,236 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000. blk_-1378031811604442201_1355
2013-10-31 18:44:39,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:48743 dest: /127.0.0.1:37740
2013-10-31 18:44:39,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:51656 dest: /127.0.0.1:34578
2013-10-31 18:44:39,282 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1378031811604442201_1355 src: /127.0.0.1:44854 dest: /127.0.0.1:59471
2013-10-31 18:44:39,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44854, dest: /127.0.0.1:59471, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1378031811604442201_1355, duration: 2025828
2013-10-31 18:44:39,286 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,286 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,286 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51656, dest: /127.0.0.1:34578, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1378031811604442201_1355, duration: 2600227
2013-10-31 18:44:39,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,287 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48743, dest: /127.0.0.1:37740, bytes: 60, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0035_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 3176931
2013-10-31 18:44:39,287 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1378031811604442201_1355 terminating
2013-10-31 18:44:39,289 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,290 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:39,290 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:39,290 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1378031811604442201_1355 size 60
2013-10-31 18:44:39,325 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0035_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:44:39,326 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:44:40,544 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031182606197_0035_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:58210
2013-10-31 18:44:40,545 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:41,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0 dst=null perm=null
2013-10-31 18:44:41,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:41,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:41,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary/_attempt_20131031182606197_0035_r_000000_0 dst=null perm=null
2013-10-31 18:44:41,915 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:41,917 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_r_000000_0 1.0% reduce > reduce
2013-10-31 18:44:41,918 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_r_000000_0 is done.
2013-10-31 18:44:41,918 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_r_000000_0 was -1
2013-10-31 18:44:41,918 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:43,548 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_r_000000_0' has completed task_20131031182606197_0035_r_000000 successfully.
2013-10-31 18:44:43,551 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0035_m_000006_0' to tip task_20131031182606197_0035_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:43,554 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0035_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:44:43,554 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0035_m_000006_0 which needs 1 slots
2013-10-31 18:44:43,554 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0035_m_000006_0 which needs 1 slots
2013-10-31 18:44:43,583 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0035/attempt_20131031182606197_0035_m_000006_0. Attempting to reuse: jvm_20131031182606197_0035_m_-1380072797
2013-10-31 18:44:44,019 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0035_m_-1380072797 given task: attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,137 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000006_0 0.0%
2013-10-31 18:44:44,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary dst=null perm=null
2013-10-31 18:44:44,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:44,293 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,293 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0035_m_000006_0
2013-10-31 18:44:44,299 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,300 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,300 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,300 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-9197354684127990610 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:44,300 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:44,301 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,301 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,301 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-3425796593221907686 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,301 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,301 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,302 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1024870396640826331 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,302 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:44,302 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:44,302 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3611869011102150252 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:44,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0035 dst=null perm=null
2013-10-31 18:44:46,585 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:46,586 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-9197354684127990610_1348 blk_-3425796593221907686_1349
2013-10-31 18:44:47,111 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0035_m_000006_0 0.0% cleanup
2013-10-31 18:44:47,112 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0035_m_000006_0 is done.
2013-10-31 18:44:47,112 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0035_m_000006_0 was -1
2013-10-31 18:44:47,113 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:47,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data3/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:47,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data3/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:47,275 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data3/current/blk_-9197354684127990610
2013-10-31 18:44:47,276 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data3/current/blk_-3425796593221907686
2013-10-31 18:44:48,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data6/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:48,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data5/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:48,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data6/current/blk_-9197354684127990610
2013-10-31 18:44:48,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data6/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:48,004 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data5/current/blk_-3425796593221907686
2013-10-31 18:44:48,005 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data6/current/blk_1024870396640826331
2013-10-31 18:44:48,005 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data5/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:48,006 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data5/current/blk_3611869011102150252
2013-10-31 18:44:48,554 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:48,554 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0035_r_000000_0
2013-10-31 18:44:49,561 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0035_m_000006_0' has completed task_20131031182606197_0035_m_000006 successfully.
2013-10-31 18:44:49,586 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:49,587 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-9197354684127990610_1348 blk_1024870396640826331_1350 blk_3611869011102150252_1351 blk_-3425796593221907686_1349
2013-10-31 18:44:49,591 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0035 has completed successfully.
2013-10-31 18:44:49,591 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0035,submitTime=1383245056926,launchTime=1383245057065,firstMapTaskLaunchTime=1383245064878,firstReduceTaskLaunchTime=1383245071531,firstJobSetupTaskLaunchTime=1383245058861,firstJobCleanupTaskLaunchTime=1383245083551,finishTime=1383245089590,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[CE7497985D0148D183840F8CF65154C9/E765166B4CC1473E97204773FB6BA846] lower+upper+offset/(1/2) .../samemergethreechaingroup
2013-10-31 18:44:49,661 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E. blk_7501251780735780255_1356
2013-10-31 18:44:49,665 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:51661 dest: /127.0.0.1:34578
2013-10-31 18:44:49,668 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:49033 dest: /127.0.0.1:54365
2013-10-31 18:44:49,670 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7501251780735780255_1356 src: /127.0.0.1:48751 dest: /127.0.0.1:37740
2013-10-31 18:44:49,679 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48751, dest: /127.0.0.1:37740, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7501251780735780255_1356, duration: 6872444
2013-10-31 18:44:49,680 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,680 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49033, dest: /127.0.0.1:54365, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7501251780735780255_1356, duration: 7700416
2013-10-31 18:44:49,681 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,681 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51661, dest: /127.0.0.1:34578, bytes: 35820, op: HDFS_WRITE, cliID: DFSClient_-858444681, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7501251780735780255_1356, duration: 8729671
2013-10-31 18:44:49,682 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7501251780735780255_1356 terminating
2013-10-31 18:44:49,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,693 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E from client DFSClient_-858444681
2013-10-31 18:44:49,693 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_logs/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E is closed by DFSClient_-858444681
2013-10-31 18:44:49,694 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,694 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7501251780735780255_1356 size 35820
2013-10-31 18:44:49,699 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0035_1383245056926_hadoop_%5BCE7497985D0148D183840F8CF65154C9%2FE765166B4CC1473E to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:49,700 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000000_0'
2013-10-31 18:44:49,701 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000001_0'
2013-10-31 18:44:49,701 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000006_0'
2013-10-31 18:44:49,702 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000007_0'
2013-10-31 18:44:49,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,703 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_r_000000_0'
2013-10-31 18:44:49,703 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,704 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8829734083624927549 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,704 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000002_0'
2013-10-31 18:44:49,704 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000003_0'
2013-10-31 18:44:49,705 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000004_0'
2013-10-31 18:44:49,705 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0035_m_000005_0'
2013-10-31 18:44:49,706 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0035_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:44:49,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0035 dst=null perm=null
2013-10-31 18:44:49,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5199617541030467941 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:49,712 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7916561388913392372 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:44:49,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:44:49,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:44:49,713 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5157468367762981491 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:44:49,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/5274502870_lower_upper_9AC12DD253D94BC0B6E953FEED098CD1 dst=null perm=null
2013-10-31 18:44:49,719 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/_temporary
2013-10-31 18:44:49,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup dst=null perm=null
2013-10-31 18:44:49,739 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:49,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000 dst=null perm=null
2013-10-31 18:44:49,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000 dst=null perm=null
2013-10-31 18:44:49,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48753, bytes: 64, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 291708
2013-10-31 18:44:49,745 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/samemergethreechaingroup
2013-10-31 18:44:49,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup dst=null perm=null
2013-10-31 18:44:49,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/samemergethreechaingroup/part-00000 dst=null perm=null
2013-10-31 18:44:49,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48754, bytes: 64, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1378031811604442201_1355, duration: 271293
2013-10-31 18:44:49,773 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:44:49,774 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:44:49,783 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:44:49,784 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:44:49,784 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace"]
2013-10-31 18:44:49,784 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:44:49,784 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:44:49,785 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:44:49,786 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...ldedpipesplatform/replace
2013-10-31 18:44:49,789 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:44:49,789 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:44:49,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:49,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:44:49,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,811 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar. blk_1418774395172716651_1357
2013-10-31 18:44:49,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:51667 dest: /127.0.0.1:34578
2013-10-31 18:44:49,813 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:49039 dest: /127.0.0.1:54365
2013-10-31 18:44:49,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:48757 dest: /127.0.0.1:37740
2013-10-31 18:44:49,825 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48757, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1418774395172716651_1357, duration: 6139941
2013-10-31 18:44:49,826 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,826 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49039, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1418774395172716651_1357, duration: 4621727
2013-10-31 18:44:49,827 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,827 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,827 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51667, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1418774395172716651_1357, duration: 5694515
2013-10-31 18:44:49,828 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1418774395172716651_1357 terminating
2013-10-31 18:44:49,828 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,832 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar from client DFSClient_-1596270109
2013-10-31 18:44:49,833 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:44:49,833 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:49,840 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar. New replication is 10
2013-10-31 18:44:49,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=null
2013-10-31 18:44:49,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,856 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:44:49,860 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:44:49,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:44:49,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,883 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split. New replication is 10
2013-10-31 18:44:49,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=null
2013-10-31 18:44:49,890 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split. blk_8337267597493363863_1358
2013-10-31 18:44:49,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:51670 dest: /127.0.0.1:34578
2013-10-31 18:44:49,893 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:44868 dest: /127.0.0.1:59471
2013-10-31 18:44:49,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:48760 dest: /127.0.0.1:37740
2013-10-31 18:44:49,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8337267597493363863_1358 src: /127.0.0.1:49044 dest: /127.0.0.1:54365
2013-10-31 18:44:49,900 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49044, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8337267597493363863_1358, duration: 108007
2013-10-31 18:44:49,900 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,901 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48760, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8337267597493363863_1358, duration: 908556
2013-10-31 18:44:49,901 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,901 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,902 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44868, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 1919708
2013-10-31 18:44:49,902 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,902 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,902 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51670, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_8337267597493363863_1358, duration: 2686931
2013-10-31 18:44:49,903 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_8337267597493363863_1358 terminating
2013-10-31 18:44:49,903 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,906 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split from client DFSClient_-1596270109
2013-10-31 18:44:49,907 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split is closed by DFSClient_-1596270109
2013-10-31 18:44:49,907 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_8337267597493363863_1358 size 1403
2013-10-31 18:44:49,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:49,927 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo. blk_-1705170389491270417_1359
2013-10-31 18:44:49,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:48762 dest: /127.0.0.1:37740
2013-10-31 18:44:49,930 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:44872 dest: /127.0.0.1:59471
2013-10-31 18:44:49,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1705170389491270417_1359 src: /127.0.0.1:49047 dest: /127.0.0.1:54365
2013-10-31 18:44:49,935 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49047, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1705170389491270417_1359, duration: 88525
2013-10-31 18:44:49,935 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44872, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1705170389491270417_1359, duration: 1017110
2013-10-31 18:44:49,936 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,936 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48762, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1705170389491270417_1359, duration: 2067128
2013-10-31 18:44:49,937 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1705170389491270417_1359 terminating
2013-10-31 18:44:49,940 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,941 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:44:49,941 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:44:49,941 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,942 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1705170389491270417_1359 size 156
2013-10-31 18:44:49,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,458 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml. blk_3392666785987107417_1360
2013-10-31 18:44:50,460 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:49048 dest: /127.0.0.1:54365
2013-10-31 18:44:50,462 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:51678 dest: /127.0.0.1:34578
2013-10-31 18:44:50,463 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3392666785987107417_1360 src: /127.0.0.1:48767 dest: /127.0.0.1:37740
2013-10-31 18:44:50,467 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48767, dest: /127.0.0.1:37740, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 751296
2013-10-31 18:44:50,468 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,468 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51678, dest: /127.0.0.1:34578, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 1531729
2013-10-31 18:44:50,469 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,469 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49048, dest: /127.0.0.1:54365, bytes: 27592, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3392666785987107417_1360, duration: 2508767
2013-10-31 18:44:50,470 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3392666785987107417_1360 terminating
2013-10-31 18:44:50,470 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,473 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml from client DFSClient_-1596270109
2013-10-31 18:44:50,473 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:44:50,473 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,474 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3392666785987107417_1360 size 27592
2013-10-31 18:44:50,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=null
2013-10-31 18:44:50,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48769, bytes: 27808, op: HDFS_READ, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 401361
2013-10-31 18:44:50,506 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0036: nMaps=4 nReduces=0 max=-1
2013-10-31 18:44:50,507 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0036 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:44:50,507 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0036
2013-10-31 18:44:50,507 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0036 RESULT=SUCCESS
2013-10-31 18:44:50,507 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0036
2013-10-31 18:44:50,508 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0036
2013-10-31 18:44:50,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,538 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml. blk_-517063638890165572_1362
2013-10-31 18:44:50,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:49053 dest: /127.0.0.1:54365
2013-10-31 18:44:50,542 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:48771 dest: /127.0.0.1:37740
2013-10-31 18:44:50,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-517063638890165572_1362 src: /127.0.0.1:44881 dest: /127.0.0.1:59471
2013-10-31 18:44:50,549 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44881, dest: /127.0.0.1:59471, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-517063638890165572_1362, duration: 696636
2013-10-31 18:44:50,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48771, dest: /127.0.0.1:37740, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-517063638890165572_1362, duration: 1952919
2013-10-31 18:44:50,551 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,551 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49053, dest: /127.0.0.1:54365, bytes: 27657, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-517063638890165572_1362, duration: 2570526
2013-10-31 18:44:50,552 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-517063638890165572_1362 terminating
2013-10-31 18:44:50,555 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,556 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,556 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-517063638890165572_1362 size 27657
2013-10-31 18:44:50,955 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml from client DFSClient_-471295458
2013-10-31 18:44:50,956 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_conf.xml is closed by DFSClient_-471295458
2013-10-31 18:44:50,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:44:50,969 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken. blk_-2610187700968762386_1363
2013-10-31 18:44:50,970 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:49056 dest: /127.0.0.1:54365
2013-10-31 18:44:50,972 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:44883 dest: /127.0.0.1:59471
2013-10-31 18:44:50,973 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2610187700968762386_1363 src: /127.0.0.1:51687 dest: /127.0.0.1:34578
2013-10-31 18:44:50,974 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51687, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 1034584
2013-10-31 18:44:50,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,975 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44883, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2610187700968762386_1363, duration: 1185097
2013-10-31 18:44:50,975 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,976 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,976 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49056, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2610187700968762386_1363, duration: 1735734
2013-10-31 18:44:50,977 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2610187700968762386_1363 terminating
2013-10-31 18:44:50,979 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,979 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken from client DFSClient_-1596270109
2013-10-31 18:44:50,980 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:44:50,981 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2610187700968762386_1363 size 116
2013-10-31 18:44:50,983 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken
2013-10-31 18:44:50,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.splitmetainfo dst=null perm=null
2013-10-31 18:44:50,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48776, bytes: 160, op: HDFS_READ, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1705170389491270417_1359, duration: 127340
2013-10-31 18:44:50,987 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0036 = 1449. Number of splits = 4
2013-10-31 18:44:50,987 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,988 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,989 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0036_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:44:50,990 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0036 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:44:50,991 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0036 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:44:51,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data2/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:51,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data1/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:51,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data2/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:51,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data1/current/blk_-3425796593221907686
2013-10-31 18:44:51,403 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data1/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:51,402 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data2/current/blk_-9197354684127990610
2013-10-31 18:44:51,403 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data1/current/blk_3611869011102150252
2013-10-31 18:44:51,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data2/current/blk_1024870396640826331
2013-10-31 18:44:51,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-9197354684127990610_1348 file build/test/data/dfs/data/data8/current/blk_-9197354684127990610 for deletion
2013-10-31 18:44:51,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-3425796593221907686_1349 file build/test/data/dfs/data/data7/current/blk_-3425796593221907686 for deletion
2013-10-31 18:44:51,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-9197354684127990610_1348 at file build/test/data/dfs/data/data8/current/blk_-9197354684127990610
2013-10-31 18:44:51,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-3425796593221907686_1349 at file build/test/data/dfs/data/data7/current/blk_-3425796593221907686
2013-10-31 18:44:51,475 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1024870396640826331_1350 file build/test/data/dfs/data/data8/current/blk_1024870396640826331 for deletion
2013-10-31 18:44:51,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3611869011102150252_1351 file build/test/data/dfs/data/data7/current/blk_3611869011102150252 for deletion
2013-10-31 18:44:51,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1024870396640826331_1350 at file build/test/data/dfs/data/data8/current/blk_1024870396640826331
2013-10-31 18:44:51,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3611869011102150252_1351 at file build/test/data/dfs/data/data7/current/blk_3611869011102150252
2013-10-31 18:44:51,905 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0036_m_000005_0' to tip task_20131031182606197_0036_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:44:51,913 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:44:51,914 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000005_0 which needs 1 slots
2013-10-31 18:44:51,914 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:51,914 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000005_0 which needs 1 slots
2013-10-31 18:44:51,914 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0035 being deleted.
2013-10-31 18:44:51,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken dst=null perm=null
2013-10-31 18:44:51,923 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51689, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 359846
2013-10-31 18:44:51,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=null
2013-10-31 18:44:51,933 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48779, bytes: 27808, op: HDFS_READ, cliID: DFSClient_-1363826906, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 387858
2013-10-31 18:44:51,957 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:51,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=null
2013-10-31 18:44:51,972 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51692, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1363826906, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1418774395172716651_1357, duration: 836609
2013-10-31 18:44:52,068 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_1321699708
2013-10-31 18:44:52,069 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_1321699708 spawned.
2013-10-31 18:44:52,071 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000005_0/taskjvm.sh
2013-10-31 18:44:52,587 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1418774395172716651_1357 to datanode(s) 127.0.0.1:59471
2013-10-31 18:44:52,587 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-8829734083624927549_1354 blk_7916561388913392372_1344 blk_5157468367762981491_1346
2013-10-31 18:44:52,587 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-8829734083624927549_1354 blk_7916561388913392372_1344 blk_5157468367762981491_1346 blk_-5199617541030467941_1347
2013-10-31 18:44:53,246 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_1321699708 given task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:44:53,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:54,403 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1418774395172716651_1357 to 127.0.0.1:59471
2013-10-31 18:44:54,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data2/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:54,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data1/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:54,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data2/current/blk_-8829734083624927549
2013-10-31 18:44:54,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data1/current/blk_5157468367762981491
2013-10-31 18:44:54,404 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data2/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:54,405 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data2/current/blk_7916561388913392372
2013-10-31 18:44:54,405 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1418774395172716651_1357 src: /127.0.0.1:44892 dest: /127.0.0.1:59471
2013-10-31 18:44:54,405 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1418774395172716651_1357 to /127.0.0.1:59471
2013-10-31 18:44:54,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1418774395172716651_1357 src: /127.0.0.1:44892 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:44:54,409 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1418774395172716651_1357 size 238055
2013-10-31 18:44:54,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data7/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:54,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data7/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:54,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data7/current/blk_-8829734083624927549
2013-10-31 18:44:54,476 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data8/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:54,477 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data7/current/blk_-5199617541030467941
2013-10-31 18:44:54,477 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data8/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:54,477 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data8/current/blk_5157468367762981491
2013-10-31 18:44:54,477 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data8/current/blk_7916561388913392372
2013-10-31 18:44:54,704 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,704 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0035_m_000006_0 not found in cache
2013-10-31 18:44:54,705 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,705 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494705
2013-10-31 18:44:54,706 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0035
2013-10-31 18:44:54,706 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494706
2013-10-31 18:44:54,707 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0035 for user-log deletion with retainTimeStamp:1383331494706
2013-10-31 18:44:54,750 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_781049111 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:54,758 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4905 with signal TERM. Exit code 0
2013-10-31 18:44:55,045 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,046 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,046 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,047 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_781049111 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,152 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1380072797 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,161 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4705 with signal TERM. Exit code 0
2013-10-31 18:44:55,264 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_1866653766 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,270 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_18439869 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,272 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4945 with signal TERM. Exit code 0
2013-10-31 18:44:55,273 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1752732000 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,276 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4943 with signal TERM. Exit code 0
2013-10-31 18:44:55,287 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4942 with signal TERM. Exit code 0
2013-10-31 18:44:55,310 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_m_-1186787883 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,314 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group4944 with signal TERM. Exit code 0
2013-10-31 18:44:55,369 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,369 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,369 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,370 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1380072797 exited with exit code 143. Number of tasks it ran: 3
2013-10-31 18:44:55,495 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,495 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,495 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,496 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_1866653766 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,496 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,497 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,497 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,497 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1752732000 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,526 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,526 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,526 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,526 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_-1186787883 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,533 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:55,533 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:55,533 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:55,534 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_m_18439869 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:55,588 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_7916561388913392372_1344 blk_-5199617541030467941_1347
2013-10-31 18:44:55,588 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-8829734083624927549_1354 blk_5157468367762981491_1346 blk_-5199617541030467941_1347
2013-10-31 18:44:55,959 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0035_r_1908169258 since job job_20131031182606197_0035 is dead
2013-10-31 18:44:55,967 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5216 with signal TERM. Exit code 0
2013-10-31 18:44:56,000 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:44:56,005 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,011 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,016 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,021 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,027 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,032 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:44:56,032 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:44:56,135 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:44:56,135 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:44:56,135 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:44:56,136 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0035_r_1908169258 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:44:56,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data4/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:56,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7916561388913392372_1344 file build/test/data/dfs/data/data3/current/blk_7916561388913392372 for deletion
2013-10-31 18:44:56,278 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data4/current/blk_-5199617541030467941
2013-10-31 18:44:56,279 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7916561388913392372_1344 at file build/test/data/dfs/data/data3/current/blk_7916561388913392372
2013-10-31 18:44:56,679 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000005_0 0.0% setup
2013-10-31 18:44:56,682 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000005_0 is done.
2013-10-31 18:44:56,682 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000005_0 was -1
2013-10-31 18:44:56,682 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:44:57,007 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8829734083624927549_1354 file build/test/data/dfs/data/data5/current/blk_-8829734083624927549 for deletion
2013-10-31 18:44:57,007 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5199617541030467941_1347 file build/test/data/dfs/data/data5/current/blk_-5199617541030467941 for deletion
2013-10-31 18:44:57,007 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8829734083624927549_1354 at file build/test/data/dfs/data/data5/current/blk_-8829734083624927549
2013-10-31 18:44:57,007 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5157468367762981491_1346 file build/test/data/dfs/data/data6/current/blk_5157468367762981491 for deletion
2013-10-31 18:44:57,008 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5199617541030467941_1347 at file build/test/data/dfs/data/data5/current/blk_-5199617541030467941
2013-10-31 18:44:57,008 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5157468367762981491_1346 at file build/test/data/dfs/data/data6/current/blk_5157468367762981491
2013-10-31 18:44:57,917 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000005_0' has completed task_20131031182606197_0036_m_000005 successfully.
2013-10-31 18:44:57,920 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000000_0' to tip task_20131031182606197_0036_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:44:57,921 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000000
2013-10-31 18:44:57,923 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:44:57,923 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000000_0 which needs 1 slots
2013-10-31 18:44:57,924 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000000_0 which needs 1 slots
2013-10-31 18:44:57,959 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1876538490
2013-10-31 18:44:57,960 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1876538490 spawned.
2013-10-31 18:44:57,962 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000000_0/taskjvm.sh
2013-10-31 18:44:58,713 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000001_0' to tip task_20131031182606197_0036_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:44:58,714 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000001
2013-10-31 18:44:58,715 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:44:58,715 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000001_0 which needs 1 slots
2013-10-31 18:44:58,715 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000002_0' to tip task_20131031182606197_0036_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:44:58,715 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000001_0 which needs 1 slots
2013-10-31 18:44:58,715 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000002
2013-10-31 18:44:58,717 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:44:58,717 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0036_m_000003_0' to tip task_20131031182606197_0036_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:44:58,717 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000002_0 which needs 1 slots
2013-10-31 18:44:58,717 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000002_0 which needs 1 slots
2013-10-31 18:44:58,717 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0036_m_000003
2013-10-31 18:44:58,718 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:44:58,718 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000003_0 which needs 1 slots
2013-10-31 18:44:58,718 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000003_0 which needs 1 slots
2013-10-31 18:44:58,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken dst=null perm=null
2013-10-31 18:44:58,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken dst=null perm=null
2013-10-31 18:44:58,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036/jobToken dst=null perm=null
2013-10-31 18:44:58,721 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51698, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 181338
2013-10-31 18:44:58,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51700, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2610187700968762386_1363, duration: 161286
2013-10-31 18:44:58,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44896, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2610187700968762386_1363, duration: 162242
2013-10-31 18:44:58,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=null
2013-10-31 18:44:58,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=null
2013-10-31 18:44:58,727 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51704, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1558358188, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 188738
2013-10-31 18:44:58,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.xml dst=null perm=null
2013-10-31 18:44:58,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48793, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1412464442, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3392666785987107417_1360, duration: 219626
2013-10-31 18:44:58,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51706, bytes: 27808, op: HDFS_READ, cliID: DFSClient_1100069603, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3392666785987107417_1360, duration: 205390
2013-10-31 18:44:58,740 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,741 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,743 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:44:58,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=null
2013-10-31 18:44:58,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=null
2013-10-31 18:44:58,755 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44904, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1558358188, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1418774395172716651_1357, duration: 757141
2013-10-31 18:44:58,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.jar dst=null perm=null
2013-10-31 18:44:58,756 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49079, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1412464442, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1418774395172716651_1357, duration: 708495
2013-10-31 18:44:58,758 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48797, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1100069603, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1418774395172716651_1357, duration: 704114
2013-10-31 18:44:58,785 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1876538490 given task: attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:44:58,815 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1109083427
2013-10-31 18:44:58,816 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1109083427 spawned.
2013-10-31 18:44:58,817 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-2092873717
2013-10-31 18:44:58,817 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-2092873717 spawned.
2013-10-31 18:44:58,824 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000001_0/taskjvm.sh
2013-10-31 18:44:58,825 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-1832274535
2013-10-31 18:44:58,826 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-1832274535 spawned.
2013-10-31 18:44:58,827 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000003_0/taskjvm.sh
2013-10-31 18:44:58,828 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000002_0/taskjvm.sh
2013-10-31 18:44:59,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=null
2013-10-31 18:44:59,878 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48799, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8337267597493363863_1358, duration: 167957
2013-10-31 18:44:59,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:44:59,918 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48800, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 112863
2013-10-31 18:44:59,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:44:59,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:00,106 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000. blk_60333104980117936_1364
2013-10-31 18:45:00,131 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:51713 dest: /127.0.0.1:34578
2013-10-31 18:45:00,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:48802 dest: /127.0.0.1:37740
2013-10-31 18:45:00,133 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_60333104980117936_1364 src: /127.0.0.1:49086 dest: /127.0.0.1:54365
2013-10-31 18:45:00,135 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49086, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_60333104980117936_1364, duration: 1252578
2013-10-31 18:45:00,135 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,136 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48802, dest: /127.0.0.1:37740, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_60333104980117936_1364, duration: 1680798
2013-10-31 18:45:00,136 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,136 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,136 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51713, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_60333104980117936_1364, duration: 2141599
2013-10-31 18:45:00,136 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_60333104980117936_1364 terminating
2013-10-31 18:45:00,137 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,138 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,139 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,140 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_60333104980117936_1364 size 40
2013-10-31 18:45:00,203 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:00,203 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000000_0 0.0%
2013-10-31 18:45:00,399 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1109083427 given task: attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:00,448 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-2092873717 given task: attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:00,452 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-1832274535 given task: attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:00,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=null
2013-10-31 18:45:00,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44919, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 167062
2013-10-31 18:45:00,926 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000000_0
2013-10-31 18:45:00,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=null
2013-10-31 18:45:00,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44920, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8337267597493363863_1358, duration: 117516
2013-10-31 18:45:00,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:00,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036/job.split dst=null perm=null
2013-10-31 18:45:00,965 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49095, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8337267597493363863_1358, duration: 157307
2013-10-31 18:45:00,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:00,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:00,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:00,987 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49096, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 151627
2013-10-31 18:45:00,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:01,005 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48814, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163284
2013-10-31 18:45:01,165 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49098, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 376977
2013-10-31 18:45:01,170 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001. blk_-2807215931494117822_1366
2013-10-31 18:45:01,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:51728 dest: /127.0.0.1:34578
2013-10-31 18:45:01,202 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:49100 dest: /127.0.0.1:54365
2013-10-31 18:45:01,204 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2807215931494117822_1366 src: /127.0.0.1:48818 dest: /127.0.0.1:37740
2013-10-31 18:45:01,207 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48818, dest: /127.0.0.1:37740, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2807215931494117822_1366, duration: 1676309
2013-10-31 18:45:01,208 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,208 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49100, dest: /127.0.0.1:54365, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2807215931494117822_1366, duration: 1853862
2013-10-31 18:45:01,208 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,209 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51728, dest: /127.0.0.1:34578, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2807215931494117822_1366, duration: 2226294
2013-10-31 18:45:01,209 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2807215931494117822_1366 terminating
2013-10-31 18:45:01,210 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,211 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,211 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,211 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,212 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2807215931494117822_1366 size 51
2013-10-31 18:45:01,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0 dst=null perm=null
2013-10-31 18:45:01,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:01,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000000_0 dst=null perm=null
2013-10-31 18:45:01,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:01,305 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,305 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000001_0 0.0%
2013-10-31 18:45:01,426 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003. blk_8966755758663425826_1367
2013-10-31 18:45:01,447 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002. blk_7218987559097650147_1367
2013-10-31 18:45:01,456 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:49102 dest: /127.0.0.1:54365
2013-10-31 18:45:01,457 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:44930 dest: /127.0.0.1:59471
2013-10-31 18:45:01,458 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_8966755758663425826_1367 src: /127.0.0.1:48822 dest: /127.0.0.1:37740
2013-10-31 18:45:01,460 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48822, dest: /127.0.0.1:37740, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_8966755758663425826_1367, duration: 1044830
2013-10-31 18:45:01,460 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44930, dest: /127.0.0.1:59471, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8966755758663425826_1367, duration: 1463273
2013-10-31 18:45:01,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,461 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,461 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:54365, bytes: 37, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8966755758663425826_1367, duration: 1864494
2013-10-31 18:45:01,461 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_8966755758663425826_1367 terminating
2013-10-31 18:45:01,462 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:01,462 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:01,462 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_8966755758663425826_1367 size 37
2013-10-31 18:45:01,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:48820 dest: /127.0.0.1:37740
2013-10-31 18:45:01,472 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:49106 dest: /127.0.0.1:54365
2013-10-31 18:45:01,473 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7218987559097650147_1367 src: /127.0.0.1:44933 dest: /127.0.0.1:59471
2013-10-31 18:45:01,475 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44933, dest: /127.0.0.1:59471, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7218987559097650147_1367, duration: 1473250
2013-10-31 18:45:01,475 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,475 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,475 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49106, dest: /127.0.0.1:54365, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7218987559097650147_1367, duration: 1670643
2013-10-31 18:45:01,476 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,476 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48820, dest: /127.0.0.1:37740, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0036_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 2058474
2013-10-31 18:45:01,476 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7218987559097650147_1367 terminating
2013-10-31 18:45:01,477 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,477 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,480 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,480 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7218987559097650147_1367 size 52
2013-10-31 18:45:01,511 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,512 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000003_0 0.0%
2013-10-31 18:45:01,525 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0036_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:01,526 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000002_0 0.0%
2013-10-31 18:45:01,718 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000002_0
2013-10-31 18:45:01,720 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000001_0
2013-10-31 18:45:01,721 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0036_m_000003_0
2013-10-31 18:45:02,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0 dst=null perm=null
2013-10-31 18:45:02,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000001_0 dst=null perm=null
2013-10-31 18:45:02,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0 dst=null perm=null
2013-10-31 18:45:02,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000003_0 dst=null perm=null
2013-10-31 18:45:02,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0 dst=null perm=null
2013-10-31 18:45:02,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:02,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:02,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary/_attempt_20131031182606197_0036_m_000002_0 dst=null perm=null
2013-10-31 18:45:02,805 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:02,807 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000000_0 is done.
2013-10-31 18:45:02,808 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000000_0 was -1
2013-10-31 18:45:02,808 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:02,924 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:45:02,924 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0036_m_000005_0
2013-10-31 18:45:02,924 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000005_0 not found in cache
2013-10-31 18:45:03,839 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:45:03,840 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000001_0 is done.
2013-10-31 18:45:03,840 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000001_0 was -1
2013-10-31 18:45:03,840 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,874 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:45:03,875 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000003_0 is done.
2013-10-31 18:45:03,875 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000003_0 was -1
2013-10-31 18:45:03,875 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,891 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:45:03,892 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000002_0 is done.
2013-10-31 18:45:03,892 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000002_0 was -1
2013-10-31 18:45:03,892 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:03,928 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000000_0' has completed task_20131031182606197_0036_m_000000 successfully.
2013-10-31 18:45:04,720 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000002_0' has completed task_20131031182606197_0036_m_000002 successfully.
2013-10-31 18:45:04,722 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000001_0' has completed task_20131031182606197_0036_m_000001 successfully.
2013-10-31 18:45:04,725 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000003_0' has completed task_20131031182606197_0036_m_000003 successfully.
2013-10-31 18:45:04,726 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0036_m_000004_0' to tip task_20131031182606197_0036_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:04,727 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0036_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:04,727 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0036_m_000004_0 which needs 1 slots
2013-10-31 18:45:04,727 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0036_m_000004_0 which needs 1 slots
2013-10-31 18:45:05,124 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0036_m_-82572748
2013-10-31 18:45:05,126 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0036_m_-82572748 spawned.
2013-10-31 18:45:05,129 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0036/attempt_20131031182606197_0036_m_000004_0/taskjvm.sh
2013-10-31 18:45:06,192 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0036_m_-82572748 given task: attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,684 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000004_0 0.0%
2013-10-31 18:45:06,687 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 1926 Total time for transactions(ms): 35Number of transactions batched in Syncs: 160 Number of syncs: 1356 SyncTimes(ms): 80101 18497
2013-10-31 18:45:06,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary dst=null perm=null
2013-10-31 18:45:06,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:06,709 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS from client DFSClient_attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,709 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0036_m_000004_0
2013-10-31 18:45:06,714 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1418774395172716651 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,715 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_8337267597493363863 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1705170389491270417 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:06,716 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3392666785987107417 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:07,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0036 dst=null perm=null
2013-10-31 18:45:07,590 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_8337267597493363863_1358
2013-10-31 18:45:07,590 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:09,011 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data6/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:09,011 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data5/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:09,012 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data6/current/blk_-1705170389491270417
2013-10-31 18:45:09,012 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data5/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:09,012 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data5/current/blk_1418774395172716651
2013-10-31 18:45:09,013 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data5/current/blk_8337267597493363863
2013-10-31 18:45:09,408 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data1/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:09,408 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data1/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:09,408 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data1/current/blk_1418774395172716651
2013-10-31 18:45:09,408 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data2/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:09,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data1/current/blk_3392666785987107417
2013-10-31 18:45:09,409 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data2/current/blk_8337267597493363863
2013-10-31 18:45:09,619 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0036_m_000004_0 0.0% cleanup
2013-10-31 18:45:09,621 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0036_m_000004_0 is done.
2013-10-31 18:45:09,621 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0036_m_000004_0 was -1
2013-10-31 18:45:09,622 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:10,591 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:10,591 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_3392666785987107417_1360 blk_1418774395172716651_1357 blk_-1705170389491270417_1359 blk_8337267597493363863_1358
2013-10-31 18:45:10,733 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0036_m_000004_0' has completed task_20131031182606197_0036_m_000004 successfully.
2013-10-31 18:45:10,733 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0036 has completed successfully.
2013-10-31 18:45:10,734 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0036,submitTime=1383245090478,launchTime=1383245090991,firstMapTaskLaunchTime=1383245097920,firstJobSetupTaskLaunchTime=1383245091905,firstJobCleanupTaskLaunchTime=1383245104726,finishTime=1383245110733,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=29,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5EB2C8475D4643F9AA8F0AF69323B4BC/38EBDF9351644F09B3E885871A6D1E25] test/(1/1) ...ldedpipesplatform/replace
2013-10-31 18:45:10,738 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09. blk_-5396516443837207735_1368
2013-10-31 18:45:10,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:44941 dest: /127.0.0.1:59471
2013-10-31 18:45:10,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:48833 dest: /127.0.0.1:37740
2013-10-31 18:45:10,743 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5396516443837207735_1368 src: /127.0.0.1:51746 dest: /127.0.0.1:34578
2013-10-31 18:45:10,744 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51746, dest: /127.0.0.1:34578, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5396516443837207735_1368, duration: 993209
2013-10-31 18:45:10,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48833, dest: /127.0.0.1:37740, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5396516443837207735_1368, duration: 1093381
2013-10-31 18:45:10,745 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,745 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44941, dest: /127.0.0.1:59471, bytes: 22669, op: HDFS_WRITE, cliID: DFSClient_-471295458, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5396516443837207735_1368, duration: 1070235
2013-10-31 18:45:10,746 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5396516443837207735_1368 terminating
2013-10-31 18:45:10,750 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,750 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 from client DFSClient_-471295458
2013-10-31 18:45:10,751 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_logs/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 is closed by DFSClient_-471295458
2013-10-31 18:45:10,751 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,751 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5396516443837207735_1368 size 22669
2013-10-31 18:45:10,760 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0036_1383245090478_hadoop_%5B5EB2C8475D4643F9AA8F0AF69323B4BC%2F38EBDF9351644F09 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:10,760 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000003_0'
2013-10-31 18:45:10,760 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000004_0'
2013-10-31 18:45:10,761 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:10,761 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:10,761 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2610187700968762386 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:10,766 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/_temporary
2013-10-31 18:45:10,767 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0036_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:10,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0036 dst=null perm=null
2013-10-31 18:45:10,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=null
2013-10-31 18:45:10,824 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:10,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000 dst=null perm=null
2013-10-31 18:45:10,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001 dst=null perm=null
2013-10-31 18:45:10,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002 dst=null perm=null
2013-10-31 18:45:10,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003 dst=null perm=null
2013-10-31 18:45:10,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000 dst=null perm=null
2013-10-31 18:45:10,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48836, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_60333104980117936_1364, duration: 289239
2013-10-31 18:45:10,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001 dst=null perm=null
2013-10-31 18:45:10,837 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48837, bytes: 55, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2807215931494117822_1366, duration: 267950
2013-10-31 18:45:10,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002 dst=null perm=null
2013-10-31 18:45:10,840 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48839, bytes: 56, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 269922
2013-10-31 18:45:10,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003 dst=null perm=null
2013-10-31 18:45:10,843 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49123, bytes: 41, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_8966755758663425826_1367, duration: 251815
2013-10-31 18:45:10,844 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/replace
2013-10-31 18:45:10,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace dst=null perm=null
2013-10-31 18:45:10,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00000 dst=null perm=null
2013-10-31 18:45:10,852 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51753, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_60333104980117936_1364, duration: 256681
2013-10-31 18:45:10,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00001 dst=null perm=null
2013-10-31 18:45:10,856 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51754, bytes: 55, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2807215931494117822_1366, duration: 251020
2013-10-31 18:45:10,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00002 dst=null perm=null
2013-10-31 18:45:10,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48843, bytes: 56, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7218987559097650147_1367, duration: 265686
2013-10-31 18:45:10,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/replace/part-00003 dst=null perm=null
2013-10-31 18:45:10,864 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44953, bytes: 41, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_8966755758663425826_1367, duration: 260093
2013-10-31 18:45:10,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,874 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt. blk_-8747971817366002935_1369
2013-10-31 18:45:10,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:44954 dest: /127.0.0.1:59471
2013-10-31 18:45:10,877 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:49129 dest: /127.0.0.1:54365
2013-10-31 18:45:10,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8747971817366002935_1369 src: /127.0.0.1:51759 dest: /127.0.0.1:34578
2013-10-31 18:45:10,882 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51759, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8747971817366002935_1369, duration: 260076
2013-10-31 18:45:10,883 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,883 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49129, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 1131126
2013-10-31 18:45:10,883 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,884 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44954, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 2040414
2013-10-31 18:45:10,884 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,884 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8747971817366002935_1369 terminating
2013-10-31 18:45:10,888 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,888 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt from client DFSClient_-1596270109
2013-10-31 18:45:10,888 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt is closed by DFSClient_-1596270109
2013-10-31 18:45:10,889 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8747971817366002935_1369 size 40
2013-10-31 18:45:10,911 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:10,912 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:10,922 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:45:10,922 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt"]
2013-10-31 18:45:10,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size"]
2013-10-31 18:45:10,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:45:10,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:45:10,923 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:45:10,924 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...esplatform/ungrouped_size
2013-10-31 18:45:10,927 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:10,927 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:45:10,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:10,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:45:10,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,947 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar. blk_4969057808391450845_1370
2013-10-31 18:45:10,949 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:51760 dest: /127.0.0.1:34578
2013-10-31 18:45:10,950 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:44958 dest: /127.0.0.1:59471
2013-10-31 18:45:10,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:49133 dest: /127.0.0.1:54365
2013-10-31 18:45:10,959 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49133, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4969057808391450845_1370, duration: 3938651
2013-10-31 18:45:10,960 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,960 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,960 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44958, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 4741355
2013-10-31 18:45:10,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,961 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51760, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4969057808391450845_1370, duration: 5797523
2013-10-31 18:45:10,961 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4969057808391450845_1370 terminating
2013-10-31 18:45:10,963 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:10,964 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:10,964 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,965 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:10,969 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar. New replication is 10
2013-10-31 18:45:10,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=null
2013-10-31 18:45:10,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:10,984 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:10,988 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:45:10,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=null
2013-10-31 18:45:10,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,002 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split. New replication is 10
2013-10-31 18:45:11,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=null
2013-10-31 18:45:11,008 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split. blk_-8554828205108058155_1371
2013-10-31 18:45:11,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:44960 dest: /127.0.0.1:59471
2013-10-31 18:45:11,011 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:49135 dest: /127.0.0.1:54365
2013-10-31 18:45:11,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:51765 dest: /127.0.0.1:34578
2013-10-31 18:45:11,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8554828205108058155_1371 src: /127.0.0.1:48854 dest: /127.0.0.1:37740
2013-10-31 18:45:11,018 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48854, dest: /127.0.0.1:37740, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8554828205108058155_1371, duration: 100238
2013-10-31 18:45:11,018 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,019 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51765, dest: /127.0.0.1:34578, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8554828205108058155_1371, duration: 1032174
2013-10-31 18:45:11,019 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,020 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49135, dest: /127.0.0.1:54365, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8554828205108058155_1371, duration: 2037827
2013-10-31 18:45:11,021 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,021 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44960, dest: /127.0.0.1:59471, bytes: 1435, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 3141560
2013-10-31 18:45:11,021 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-8554828205108058155_1371 terminating
2013-10-31 18:45:11,023 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,023 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split from client DFSClient_-1596270109
2013-10-31 18:45:11,024 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:11,024 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,025 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,026 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8554828205108058155_1371 size 1435
2013-10-31 18:45:11,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,044 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo. blk_-2128509859462032642_1372
2013-10-31 18:45:11,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:48855 dest: /127.0.0.1:37740
2013-10-31 18:45:11,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:49139 dest: /127.0.0.1:54365
2013-10-31 18:45:11,048 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2128509859462032642_1372 src: /127.0.0.1:44966 dest: /127.0.0.1:59471
2013-10-31 18:45:11,051 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44966, dest: /127.0.0.1:59471, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2128509859462032642_1372, duration: 69761
2013-10-31 18:45:11,051 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,052 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49139, dest: /127.0.0.1:54365, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2128509859462032642_1372, duration: 935170
2013-10-31 18:45:11,052 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,053 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48855, dest: /127.0.0.1:37740, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2128509859462032642_1372, duration: 1740324
2013-10-31 18:45:11,053 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2128509859462032642_1372 terminating
2013-10-31 18:45:11,055 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,055 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:11,056 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:11,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,056 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2128509859462032642_1372 size 148
2013-10-31 18:45:11,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:11,083 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml. blk_-1951060055773038883_1373
2013-10-31 18:45:11,084 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:48858 dest: /127.0.0.1:37740
2013-10-31 18:45:11,085 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:49142 dest: /127.0.0.1:54365
2013-10-31 18:45:11,086 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1951060055773038883_1373 src: /127.0.0.1:51772 dest: /127.0.0.1:34578
2013-10-31 18:45:11,088 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51772, dest: /127.0.0.1:34578, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1951060055773038883_1373, duration: 1003287
2013-10-31 18:45:11,088 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,088 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49142, dest: /127.0.0.1:54365, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1951060055773038883_1373, duration: 1225521
2013-10-31 18:45:11,089 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,089 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48858, dest: /127.0.0.1:37740, bytes: 27503, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 1309432
2013-10-31 18:45:11,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,089 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1951060055773038883_1373 terminating
2013-10-31 18:45:11,092 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,092 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1951060055773038883_1373 size 27503
2013-10-31 18:45:11,092 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:11,093 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:11,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data3/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:11,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data3/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:11,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data3/current/blk_-1705170389491270417
2013-10-31 18:45:11,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data4/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:11,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data3/current/blk_1418774395172716651
2013-10-31 18:45:11,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data4/current/blk_3392666785987107417
2013-10-31 18:45:11,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data4/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:11,285 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data4/current/blk_8337267597493363863
2013-10-31 18:45:11,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=null
2013-10-31 18:45:11,993 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49145, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-287585837, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1951060055773038883_1373, duration: 405289
2013-10-31 18:45:12,012 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0037: nMaps=4 nReduces=0 max=-1
2013-10-31 18:45:12,012 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0037 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:12,012 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0037
2013-10-31 18:45:12,013 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0037
2013-10-31 18:45:12,012 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0037 RESULT=SUCCESS
2013-10-31 18:45:12,014 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0037
2013-10-31 18:45:12,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,035 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml. blk_-4204607545426031275_1375
2013-10-31 18:45:12,036 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:44972 dest: /127.0.0.1:59471
2013-10-31 18:45:12,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:51776 dest: /127.0.0.1:34578
2013-10-31 18:45:12,038 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4204607545426031275_1375 src: /127.0.0.1:48865 dest: /127.0.0.1:37740
2013-10-31 18:45:12,040 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48865, dest: /127.0.0.1:37740, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4204607545426031275_1375, duration: 1416573
2013-10-31 18:45:12,041 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,041 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51776, dest: /127.0.0.1:34578, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4204607545426031275_1375, duration: 562742
2013-10-31 18:45:12,041 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,042 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,042 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44972, dest: /127.0.0.1:59471, bytes: 27568, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4204607545426031275_1375, duration: 1148306
2013-10-31 18:45:12,042 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,042 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4204607545426031275_1375 terminating
2013-10-31 18:45:12,043 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml from client DFSClient_-287585837
2013-10-31 18:45:12,043 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_conf.xml is closed by DFSClient_-287585837
2013-10-31 18:45:12,044 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4204607545426031275_1375 size 27568
2013-10-31 18:45:12,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:12,057 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken. blk_5370586274571019240_1376
2013-10-31 18:45:12,058 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:48866 dest: /127.0.0.1:37740
2013-10-31 18:45:12,060 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:44976 dest: /127.0.0.1:59471
2013-10-31 18:45:12,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5370586274571019240_1376 src: /127.0.0.1:49151 dest: /127.0.0.1:54365
2013-10-31 18:45:12,065 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49151, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5370586274571019240_1376, duration: 548149
2013-10-31 18:45:12,066 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,066 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:44976, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 1359594
2013-10-31 18:45:12,067 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,067 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48866, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5370586274571019240_1376, duration: 2388692
2013-10-31 18:45:12,068 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,068 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5370586274571019240_1376 terminating
2013-10-31 18:45:12,070 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,070 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:12,071 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:12,072 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5370586274571019240_1376 size 116
2013-10-31 18:45:12,081 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken
2013-10-31 18:45:12,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.splitmetainfo dst=null perm=null
2013-10-31 18:45:12,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44978, bytes: 152, op: HDFS_READ, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2128509859462032642_1372, duration: 318842
2013-10-31 18:45:12,086 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0037 = 40. Number of splits = 4
2013-10-31 18:45:12,087 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,087 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,087 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,088 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,089 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0037_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:12,090 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0037 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:12,090 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0037 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:45:12,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1705170389491270417_1359 file build/test/data/dfs/data/data8/current/blk_-1705170389491270417 for deletion
2013-10-31 18:45:12,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1418774395172716651_1357 file build/test/data/dfs/data/data8/current/blk_1418774395172716651 for deletion
2013-10-31 18:45:12,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1705170389491270417_1359 at file build/test/data/dfs/data/data8/current/blk_-1705170389491270417
2013-10-31 18:45:12,482 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3392666785987107417_1360 file build/test/data/dfs/data/data7/current/blk_3392666785987107417 for deletion
2013-10-31 18:45:12,483 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1418774395172716651_1357 at file build/test/data/dfs/data/data8/current/blk_1418774395172716651
2013-10-31 18:45:12,483 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3392666785987107417_1360 at file build/test/data/dfs/data/data7/current/blk_3392666785987107417
2013-10-31 18:45:12,483 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_8337267597493363863_1358 file build/test/data/dfs/data/data7/current/blk_8337267597493363863 for deletion
2013-10-31 18:45:12,484 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_8337267597493363863_1358 at file build/test/data/dfs/data/data7/current/blk_8337267597493363863
2013-10-31 18:45:12,938 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0037_m_000005_0' to tip task_20131031182606197_0037_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:12,942 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000000_0'
2013-10-31 18:45:12,942 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000005_0'
2013-10-31 18:45:12,944 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:45:12,944 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000005_0 which needs 1 slots
2013-10-31 18:45:12,945 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000005_0 which needs 1 slots
2013-10-31 18:45:12,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken dst=null perm=null
2013-10-31 18:45:12,952 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44979, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 273450
2013-10-31 18:45:12,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=null
2013-10-31 18:45:12,962 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48872, bytes: 27719, op: HDFS_READ, cliID: DFSClient_75958969, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 387903
2013-10-31 18:45:12,992 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:13,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=null
2013-10-31 18:45:13,023 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44982, bytes: 239915, op: HDFS_READ, cliID: DFSClient_75958969, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 1187778
2013-10-31 18:45:13,113 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0036_m_-1876538490
2013-10-31 18:45:13,123 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5595 with signal TERM. Exit code 0
2013-10-31 18:45:13,123 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1315758328
2013-10-31 18:45:13,124 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1315758328 spawned.
2013-10-31 18:45:13,127 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000005_0/taskjvm.sh
2013-10-31 18:45:13,326 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_4155904879908459364_1040
2013-10-31 18:45:13,592 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_4969057808391450845_1370 to datanode(s) 127.0.0.1:37740
2013-10-31 18:45:13,592 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-2610187700968762386_1363
2013-10-31 18:45:13,592 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-2610187700968762386_1363
2013-10-31 18:45:13,601 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:13,601 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:13,601 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:13,601 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1876538490 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:13,731 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000001_0'
2013-10-31 18:45:13,732 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0036_m_000002_0'
2013-10-31 18:45:14,283 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data4/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:14,284 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data4/current/blk_-2610187700968762386
2013-10-31 18:45:14,363 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1315758328 given task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:14,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:15,013 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_4969057808391450845_1370 to 127.0.0.1:37740
2013-10-31 18:45:15,015 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4969057808391450845_1370 src: /127.0.0.1:48877 dest: /127.0.0.1:37740
2013-10-31 18:45:15,015 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_4969057808391450845_1370 to /127.0.0.1:37740
2013-10-31 18:45:15,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_4969057808391450845_1370 src: /127.0.0.1:48877 dest: /127.0.0.1:37740 of size 238055
2013-10-31 18:45:15,023 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4969057808391450845_1370 size 238055
2013-10-31 18:45:15,410 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data2/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:15,410 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data2/current/blk_-2610187700968762386
2013-10-31 18:45:15,761 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:15,762 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000003_0 not found in cache
2013-10-31 18:45:15,762 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000004_0 not found in cache
2013-10-31 18:45:15,763 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331515762
2013-10-31 18:45:16,193 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-82572748 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:16,204 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6406 with signal TERM. Exit code 0
2013-10-31 18:45:16,379 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:16,380 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:16,380 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:16,380 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-82572748 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:16,424 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-2092873717 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:16,434 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5721 with signal TERM. Exit code 0
2013-10-31 18:45:16,593 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-2610187700968762386_1363
2013-10-31 18:45:16,624 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:16,624 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:16,624 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:16,625 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-2092873717 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:17,782 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000005_0 0.0% setup
2013-10-31 18:45:17,785 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000005_0 is done.
2013-10-31 18:45:17,785 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000005_0 was -1
2013-10-31 18:45:17,785 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:17,945 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:17,945 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000000_0 not found in cache
2013-10-31 18:45:17,946 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331517945
2013-10-31 18:45:18,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2610187700968762386_1363 file build/test/data/dfs/data/data6/current/blk_-2610187700968762386 for deletion
2013-10-31 18:45:18,014 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2610187700968762386_1363 at file build/test/data/dfs/data/data6/current/blk_-2610187700968762386
2013-10-31 18:45:18,261 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_1321699708 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:18,270 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5425 with signal TERM. Exit code 0
2013-10-31 18:45:18,530 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:18,530 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:18,531 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:18,532 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_1321699708 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:18,731 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:18,732 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000001_0 not found in cache
2013-10-31 18:45:18,732 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331518732
2013-10-31 18:45:18,732 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0036
2013-10-31 18:45:18,733 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0036_m_000002_0 not found in cache
2013-10-31 18:45:18,734 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0036 for user-log deletion with retainTimeStamp:1383331518734
2013-10-31 18:45:18,950 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000005_0' has completed task_20131031182606197_0037_m_000005 successfully.
2013-10-31 18:45:18,955 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000000_0' to tip task_20131031182606197_0037_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:18,956 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000000
2013-10-31 18:45:18,958 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:45:18,958 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000000_0 which needs 1 slots
2013-10-31 18:45:18,958 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000000_0 which needs 1 slots
2013-10-31 18:45:18,995 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-1272420910
2013-10-31 18:45:18,996 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-1272420910 spawned.
2013-10-31 18:45:18,998 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000000_0/taskjvm.sh
2013-10-31 18:45:19,402 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-1109083427 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:19,410 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5690 with signal TERM. Exit code 0
2013-10-31 18:45:19,446 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0036_m_-1832274535 since job job_20131031182606197_0036 is dead
2013-10-31 18:45:19,450 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group5720 with signal TERM. Exit code 0
2013-10-31 18:45:19,576 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:19,576 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:19,576 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:19,576 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1109083427 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:19,608 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:19,608 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:19,608 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:19,608 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0036_m_-1832274535 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:19,738 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000001_0' to tip task_20131031182606197_0037_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:45:19,738 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000001
2013-10-31 18:45:19,739 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000002_0' to tip task_20131031182606197_0037_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:19,740 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:45:19,740 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000002
2013-10-31 18:45:19,740 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000001_0 which needs 1 slots
2013-10-31 18:45:19,741 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000001_0 which needs 1 slots
2013-10-31 18:45:19,741 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:45:19,742 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000002_0 which needs 1 slots
2013-10-31 18:45:19,742 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000002_0 which needs 1 slots
2013-10-31 18:45:19,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken dst=null perm=null
2013-10-31 18:45:19,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken dst=null perm=null
2013-10-31 18:45:19,746 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44988, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5370586274571019240_1376, duration: 146872
2013-10-31 18:45:19,759 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5370586274571019240_1376, duration: 146790
2013-10-31 18:45:19,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=null
2013-10-31 18:45:19,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=null
2013-10-31 18:45:19,763 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48883, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-2140004092, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 156425
2013-10-31 18:45:19,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48884, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-722249252, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 167048
2013-10-31 18:45:19,769 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0037_m_000003_0' to tip task_20131031182606197_0037_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:19,769 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0037_m_000003
2013-10-31 18:45:19,770 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:45:19,770 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000003_0 which needs 1 slots
2013-10-31 18:45:19,770 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000003_0 which needs 1 slots
2013-10-31 18:45:19,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037/jobToken dst=null perm=null
2013-10-31 18:45:19,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49168, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5370586274571019240_1376, duration: 127823
2013-10-31 18:45:19,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.xml dst=null perm=null
2013-10-31 18:45:19,779 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,780 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,780 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48887, bytes: 27719, op: HDFS_READ, cliID: DFSClient_-1213225089, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1951060055773038883_1373, duration: 163255
2013-10-31 18:45:19,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=null
2013-10-31 18:45:19,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=null
2013-10-31 18:45:19,794 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:19,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49171, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-2140004092, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4969057808391450845_1370, duration: 753739
2013-10-31 18:45:19,796 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48889, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-722249252, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4969057808391450845_1370, duration: 712502
2013-10-31 18:45:19,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.jar dst=null perm=null
2013-10-31 18:45:19,808 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:44999, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1213225089, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4969057808391450845_1370, duration: 585773
2013-10-31 18:45:19,854 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1256737587
2013-10-31 18:45:19,855 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1256737587 spawned.
2013-10-31 18:45:19,855 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-1087900185
2013-10-31 18:45:19,855 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-1087900185 spawned.
2013-10-31 18:45:19,857 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000001_0/taskjvm.sh
2013-10-31 18:45:19,857 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000002_0/taskjvm.sh
2013-10-31 18:45:19,859 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-1272420910 given task: attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:19,863 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_-116763129
2013-10-31 18:45:19,864 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_-116763129 spawned.
2013-10-31 18:45:19,865 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000003_0/taskjvm.sh
2013-10-31 18:45:21,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=null
2013-10-31 18:45:21,072 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45001, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 173780
2013-10-31 18:45:21,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=null
2013-10-31 18:45:21,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:21,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:21,297 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49176, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 164107
2013-10-31 18:45:21,302 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000. blk_-1300939559458420103_1377
2013-10-31 18:45:21,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:51806 dest: /127.0.0.1:34578
2013-10-31 18:45:21,327 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:49178 dest: /127.0.0.1:54365
2013-10-31 18:45:21,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1300939559458420103_1377 src: /127.0.0.1:48896 dest: /127.0.0.1:37740
2013-10-31 18:45:21,331 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48896, dest: /127.0.0.1:37740, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1300939559458420103_1377, duration: 1522273
2013-10-31 18:45:21,331 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,331 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49178, dest: /127.0.0.1:54365, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1300939559458420103_1377, duration: 1723227
2013-10-31 18:45:21,331 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,332 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51806, dest: /127.0.0.1:34578, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 2271393
2013-10-31 18:45:21,332 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1300939559458420103_1377 terminating
2013-10-31 18:45:21,333 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,333 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:21,333 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:21,333 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,334 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1300939559458420103_1377 size 24
2013-10-31 18:45:21,385 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:21,385 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000000_0 0.0%
2013-10-31 18:45:21,600 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-1087900185 given task: attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:21,604 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1256737587 given task: attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:21,609 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_-116763129 given task: attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:21,960 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000000_0
2013-10-31 18:45:22,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=null
2013-10-31 18:45:22,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=null
2013-10-31 18:45:22,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037/job.split dst=null perm=null
2013-10-31 18:45:22,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45012, bytes: 1447, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8554828205108058155_1371, duration: 163453
2013-10-31 18:45:22,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49187, bytes: 931, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8554828205108058155_1371, duration: 152543
2013-10-31 18:45:22,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48905, bytes: 415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8554828205108058155_1371, duration: 121140
2013-10-31 18:45:22,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=null
2013-10-31 18:45:22,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=null
2013-10-31 18:45:22,143 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49189, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8747971817366002935_1369, duration: 120046
2013-10-31 18:45:22,143 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45016, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 114291
2013-10-31 18:45:22,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt dst=null perm=null
2013-10-31 18:45:22,146 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45017, bytes: 44, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8747971817366002935_1369, duration: 117390
2013-10-31 18:45:22,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:22,385 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001. blk_-8381727752134553355_1380
2013-10-31 18:45:22,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0 dst=null perm=null
2013-10-31 18:45:22,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:22,425 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:49192 dest: /127.0.0.1:54365
2013-10-31 18:45:22,426 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:51822 dest: /127.0.0.1:34578
2013-10-31 18:45:22,426 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8381727752134553355_1380 src: /127.0.0.1:45020 dest: /127.0.0.1:59471
2013-10-31 18:45:22,428 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45020, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 959074
2013-10-31 18:45:22,429 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,429 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51822, dest: /127.0.0.1:34578, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8381727752134553355_1380, duration: 1369553
2013-10-31 18:45:22,431 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,431 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:22,433 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49192, dest: /127.0.0.1:54365, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8381727752134553355_1380, duration: 5064119
2013-10-31 18:45:22,433 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:22,433 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8381727752134553355_1380 terminating
2013-10-31 18:45:22,434 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:22,434 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:22,434 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8381727752134553355_1380 size 12
2013-10-31 18:45:23,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:23,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000000_0 dst=null perm=null
2013-10-31 18:45:23,648 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,648 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 0.0%
2013-10-31 18:45:23,766 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003. blk_-9186458009821184877_1380
2013-10-31 18:45:23,767 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002. blk_3519506000020369794_1380
2013-10-31 18:45:23,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:51824 dest: /127.0.0.1:34578
2013-10-31 18:45:23,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:48914 dest: /127.0.0.1:37740
2013-10-31 18:45:23,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9186458009821184877_1380 src: /127.0.0.1:45024 dest: /127.0.0.1:59471
2013-10-31 18:45:23,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:48913 dest: /127.0.0.1:37740
2013-10-31 18:45:23,791 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:45025 dest: /127.0.0.1:59471
2013-10-31 18:45:23,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3519506000020369794_1380 src: /127.0.0.1:49200 dest: /127.0.0.1:54365
2013-10-31 18:45:23,792 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45024, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-9186458009821184877_1380, duration: 772312
2013-10-31 18:45:23,792 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48914, dest: /127.0.0.1:37740, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9186458009821184877_1380, duration: 1110113
2013-10-31 18:45:23,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,793 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51824, dest: /127.0.0.1:34578, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 1521710
2013-10-31 18:45:23,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,793 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9186458009821184877_1380 terminating
2013-10-31 18:45:23,794 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,794 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:23,795 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:23,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49200, dest: /127.0.0.1:54365, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3519506000020369794_1380, duration: 1129505
2013-10-31 18:45:23,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,795 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45025, dest: /127.0.0.1:59471, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3519506000020369794_1380, duration: 1503374
2013-10-31 18:45:23,795 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,796 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48913, dest: /127.0.0.1:37740, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0037_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3519506000020369794_1380, duration: 1910655
2013-10-31 18:45:23,796 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9186458009821184877_1380 size 12
2013-10-31 18:45:23,796 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3519506000020369794_1380 terminating
2013-10-31 18:45:23,796 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,797 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:23,797 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:23,797 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3519506000020369794_1380 size 12
2013-10-31 18:45:23,846 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,847 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 0.0%
2013-10-31 18:45:23,854 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0037_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:23,854 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 0.0%
2013-10-31 18:45:23,958 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:23,959 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0037_m_000005_0
2013-10-31 18:45:23,959 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000005_0 not found in cache
2013-10-31 18:45:23,996 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:0+10
2013-10-31 18:45:23,998 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000000_0 is done.
2013-10-31 18:45:23,998 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000000_0 was -1
2013-10-31 18:45:23,999 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:24,964 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000000_0' has completed task_20131031182606197_0037_m_000000 successfully.
2013-10-31 18:45:25,747 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000001_0
2013-10-31 18:45:25,748 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000002_0
2013-10-31 18:45:25,776 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0037_m_000003_0
2013-10-31 18:45:25,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0 dst=null perm=null
2013-10-31 18:45:25,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:25,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0 dst=null perm=null
2013-10-31 18:45:25,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:25,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:25,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000003_0 dst=null perm=null
2013-10-31 18:45:25,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:25,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000002_0 dst=null perm=null
2013-10-31 18:45:26,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0 dst=null perm=null
2013-10-31 18:45:26,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:26,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:26,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary/_attempt_20131031182606197_0037_m_000001_0 dst=null perm=null
2013-10-31 18:45:28,075 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:20+10
2013-10-31 18:45:28,076 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:10+10
2013-10-31 18:45:28,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:20+10
2013-10-31 18:45:28,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:30+10
2013-10-31 18:45:28,077 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000002_0 is done.
2013-10-31 18:45:28,077 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:10+10
2013-10-31 18:45:28,078 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000002_0 was -1
2013-10-31 18:45:28,078 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,078 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000001_0 is done.
2013-10-31 18:45:28,078 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000001_0 was -1
2013-10-31 18:45:28,078 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,079 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/extra+lower+upper.txt:30+10
2013-10-31 18:45:28,079 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000003_0 is done.
2013-10-31 18:45:28,079 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000003_0 was -1
2013-10-31 18:45:28,079 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:28,749 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000001_0' has completed task_20131031182606197_0037_m_000001 successfully.
2013-10-31 18:45:28,814 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000003_0' has completed task_20131031182606197_0037_m_000003 successfully.
2013-10-31 18:45:28,816 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000002_0' has completed task_20131031182606197_0037_m_000002 successfully.
2013-10-31 18:45:28,819 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0037_m_000004_0' to tip task_20131031182606197_0037_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:28,821 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0037_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:28,822 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0037_m_000004_0 which needs 1 slots
2013-10-31 18:45:28,822 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0037_m_000004_0 which needs 1 slots
2013-10-31 18:45:28,858 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0037_m_1185596558
2013-10-31 18:45:28,859 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0037_m_1185596558 spawned.
2013-10-31 18:45:28,861 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0037/attempt_20131031182606197_0037_m_000004_0/taskjvm.sh
2013-10-31 18:45:29,704 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0037_m_1185596558 given task: attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,201 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000004_0 0.0%
2013-10-31 18:45:30,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary dst=null perm=null
2013-10-31 18:45:30,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:30,223 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS from client DFSClient_attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,223 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0037_m_000004_0
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4969057808391450845 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,230 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8554828205108058155 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2128509859462032642 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:30,231 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1951060055773038883 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:30,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0037 dst=null perm=null
2013-10-31 18:45:31,595 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371
2013-10-31 18:45:31,596 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_4969057808391450845_1370 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:33,018 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data5/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:33,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data6/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:33,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data6/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:33,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data5/current/blk_-8554828205108058155
2013-10-31 18:45:33,019 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data6/current/blk_-2128509859462032642
2013-10-31 18:45:33,020 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data6/current/blk_4969057808391450845
2013-10-31 18:45:33,116 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0037_m_000004_0 0.0% cleanup
2013-10-31 18:45:33,116 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0037_m_000004_0 is done.
2013-10-31 18:45:33,117 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0037_m_000004_0 was -1
2013-10-31 18:45:33,117 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:33,416 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data2/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:33,416 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data1/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:33,416 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data2/current/blk_-8554828205108058155
2013-10-31 18:45:33,417 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data1/current/blk_-1951060055773038883
2013-10-31 18:45:33,417 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data1/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:33,417 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data1/current/blk_4969057808391450845
2013-10-31 18:45:34,596 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:34,596 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_4969057808391450845_1370 blk_-1951060055773038883_1373 blk_-8554828205108058155_1371 blk_-2128509859462032642_1372
2013-10-31 18:45:34,829 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0037_m_000004_0' has completed task_20131031182606197_0037_m_000004 successfully.
2013-10-31 18:45:34,830 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0037 has completed successfully.
2013-10-31 18:45:34,830 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0037,submitTime=1383245111983,launchTime=1383245112090,firstMapTaskLaunchTime=1383245118955,firstJobSetupTaskLaunchTime=1383245112938,firstJobCleanupTaskLaunchTime=1383245128818,finishTime=1383245134830,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[35F2C65797D24761B721335B4F0750B8/E9C2C135605D403F9213DC49DCB08C40] test/(1/1) ...esplatform/ungrouped_size
2013-10-31 18:45:34,837 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F. blk_-2748175481835955132_1381
2013-10-31 18:45:34,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:45034 dest: /127.0.0.1:59471
2013-10-31 18:45:34,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:51838 dest: /127.0.0.1:34578
2013-10-31 18:45:34,843 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2748175481835955132_1381 src: /127.0.0.1:49210 dest: /127.0.0.1:54365
2013-10-31 18:45:34,853 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49210, dest: /127.0.0.1:54365, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2748175481835955132_1381, duration: 4750006
2013-10-31 18:45:34,853 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,854 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51838, dest: /127.0.0.1:34578, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2748175481835955132_1381, duration: 4036484
2013-10-31 18:45:34,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,855 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,855 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45034, dest: /127.0.0.1:59471, bytes: 22657, op: HDFS_WRITE, cliID: DFSClient_-287585837, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2748175481835955132_1381, duration: 7825117
2013-10-31 18:45:34,855 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,855 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2748175481835955132_1381 terminating
2013-10-31 18:45:34,859 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2748175481835955132_1381 size 22657
2013-10-31 18:45:34,860 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F from client DFSClient_-287585837
2013-10-31 18:45:34,860 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_logs/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F is closed by DFSClient_-287585837
2013-10-31 18:45:34,868 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0037_1383245111983_hadoop_%5B35F2C65797D24761B721335B4F0750B8%2FE9C2C135605D403F to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:34,869 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000002_0'
2013-10-31 18:45:34,869 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000004_0'
2013-10-31 18:45:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:34,871 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5370586274571019240 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:34,875 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0037_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:34,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0037 dst=null perm=null
2013-10-31 18:45:34,877 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/_temporary
2013-10-31 18:45:34,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=null
2013-10-31 18:45:34,907 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:34,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 dst=null perm=null
2013-10-31 18:45:34,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001 dst=null perm=null
2013-10-31 18:45:34,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002 dst=null perm=null
2013-10-31 18:45:34,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003 dst=null perm=null
2013-10-31 18:45:34,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 dst=null perm=null
2013-10-31 18:45:34,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51841, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 302859
2013-10-31 18:45:34,913 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated HDFSReadBytes 201 raw values into 1 aggregated values, total 6
2013-10-31 18:45:34,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001 dst=null perm=null
2013-10-31 18:45:34,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45039, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 275195
2013-10-31 18:45:34,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002 dst=null perm=null
2013-10-31 18:45:34,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45040, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3519506000020369794_1380, duration: 262061
2013-10-31 18:45:34,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003 dst=null perm=null
2013-10-31 18:45:34,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51844, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 260045
2013-10-31 18:45:34,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=null
2013-10-31 18:45:34,926 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:34,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 dst=null perm=null
2013-10-31 18:45:34,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001 dst=null perm=null
2013-10-31 18:45:34,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002 dst=null perm=null
2013-10-31 18:45:34,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003 dst=null perm=null
2013-10-31 18:45:34,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 dst=null perm=null
2013-10-31 18:45:34,931 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51845, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1300939559458420103_1377, duration: 139765
2013-10-31 18:45:34,931 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/ungrouped_size
2013-10-31 18:45:34,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size dst=null perm=null
2013-10-31 18:45:34,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00000 dst=null perm=null
2013-10-31 18:45:34,935 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48934, bytes: 28, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1300939559458420103_1377, duration: 141642
2013-10-31 18:45:34,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00001 dst=null perm=null
2013-10-31 18:45:34,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45044, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8381727752134553355_1380, duration: 133821
2013-10-31 18:45:34,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00002 dst=null perm=null
2013-10-31 18:45:34,940 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49219, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3519506000020369794_1380, duration: 133386
2013-10-31 18:45:34,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/ungrouped_size/part-00003 dst=null perm=null
2013-10-31 18:45:34,943 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51849, bytes: 16, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9186458009821184877_1380, duration: 147043
2013-10-31 18:45:34,952 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:34,953 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:34,962 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:45:34,963 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:45:34,963 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter"]
2013-10-31 18:45:34,963 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:45:34,964 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:45:34,964 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:45:34,965 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...eldedpipesplatform/filter
2013-10-31 18:45:34,968 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:34,969 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:45:34,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:34,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:45:34,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:34,995 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar. blk_-2859678223868609014_1382
2013-10-31 18:45:34,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:49221 dest: /127.0.0.1:54365
2013-10-31 18:45:34,998 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:48939 dest: /127.0.0.1:37740
2013-10-31 18:45:35,000 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:45049 dest: /127.0.0.1:59471
2013-10-31 18:45:35,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45049, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2859678223868609014_1382, duration: 4132787
2013-10-31 18:45:35,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,009 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48939, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2859678223868609014_1382, duration: 5176959
2013-10-31 18:45:35,009 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,010 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49221, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2859678223868609014_1382, duration: 6197168
2013-10-31 18:45:35,010 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2859678223868609014_1382 terminating
2013-10-31 18:45:35,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,013 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,014 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:35,291 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data3/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:35,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data4/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:35,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data3/current/blk_-8554828205108058155
2013-10-31 18:45:35,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data4/current/blk_-2128509859462032642
2013-10-31 18:45:35,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data3/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:35,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data4/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:35,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data3/current/blk_-1951060055773038883
2013-10-31 18:45:35,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data4/current/blk_4969057808391450845
2013-10-31 18:45:35,413 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:35,413 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:35,422 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar. New replication is 10
2013-10-31 18:45:35,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=null
2013-10-31 18:45:35,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,437 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:35,442 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:45:35,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:35,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,460 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split. New replication is 10
2013-10-31 18:45:35,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=null
2013-10-31 18:45:35,468 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split. blk_7884357659738796485_1383
2013-10-31 18:45:35,469 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:49224 dest: /127.0.0.1:54365
2013-10-31 18:45:35,471 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:51854 dest: /127.0.0.1:34578
2013-10-31 18:45:35,473 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:45052 dest: /127.0.0.1:59471
2013-10-31 18:45:35,474 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7884357659738796485_1383 src: /127.0.0.1:48944 dest: /127.0.0.1:37740
2013-10-31 18:45:35,478 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48944, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 875664
2013-10-31 18:45:35,479 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,479 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45052, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7884357659738796485_1383, duration: 1655952
2013-10-31 18:45:35,480 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,480 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51854, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7884357659738796485_1383, duration: 2608487
2013-10-31 18:45:35,481 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,481 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49224, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7884357659738796485_1383, duration: 3533755
2013-10-31 18:45:35,482 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7884357659738796485_1383 terminating
2013-10-31 18:45:35,483 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,484 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split from client DFSClient_-1596270109
2013-10-31 18:45:35,484 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:35,484 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,485 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,485 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7884357659738796485_1383 size 1403
2013-10-31 18:45:35,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,500 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo. blk_-4117612380754601010_1384
2013-10-31 18:45:35,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:51857 dest: /127.0.0.1:34578
2013-10-31 18:45:35,503 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:49229 dest: /127.0.0.1:54365
2013-10-31 18:45:35,505 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4117612380754601010_1384 src: /127.0.0.1:48947 dest: /127.0.0.1:37740
2013-10-31 18:45:35,508 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48947, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4117612380754601010_1384, duration: 544039
2013-10-31 18:45:35,508 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,509 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49229, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-4117612380754601010_1384, duration: 1326330
2013-10-31 18:45:35,509 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,510 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51857, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4117612380754601010_1384, duration: 2241253
2013-10-31 18:45:35,510 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,511 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4117612380754601010_1384 terminating
2013-10-31 18:45:35,513 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:35,513 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:35,513 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4117612380754601010_1384 size 156
2013-10-31 18:45:35,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:35,539 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml. blk_5343639107369864272_1385
2013-10-31 18:45:35,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:48948 dest: /127.0.0.1:37740
2013-10-31 18:45:35,542 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:49232 dest: /127.0.0.1:54365
2013-10-31 18:45:35,543 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5343639107369864272_1385 src: /127.0.0.1:45059 dest: /127.0.0.1:59471
2013-10-31 18:45:35,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45059, dest: /127.0.0.1:59471, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 2564869
2013-10-31 18:45:35,550 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,550 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49232, dest: /127.0.0.1:54365, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 2758287
2013-10-31 18:45:35,551 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,551 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48948, dest: /127.0.0.1:37740, bytes: 27287, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5343639107369864272_1385, duration: 4298558
2013-10-31 18:45:35,552 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5343639107369864272_1385 terminating
2013-10-31 18:45:35,553 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,553 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:35,554 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:35,554 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,555 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5343639107369864272_1385 size 27287
2013-10-31 18:45:35,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=null
2013-10-31 18:45:35,571 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49235, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 393915
2013-10-31 18:45:35,590 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0038: nMaps=4 nReduces=0 max=-1
2013-10-31 18:45:35,590 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0038 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:35,590 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0038
2013-10-31 18:45:35,591 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0038 RESULT=SUCCESS
2013-10-31 18:45:35,591 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0038
2013-10-31 18:45:35,592 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0038
2013-10-31 18:45:36,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,135 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml. blk_-5380214336378028840_1387
2013-10-31 18:45:36,137 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:48954 dest: /127.0.0.1:37740
2013-10-31 18:45:36,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:45064 dest: /127.0.0.1:59471
2013-10-31 18:45:36,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5380214336378028840_1387 src: /127.0.0.1:51868 dest: /127.0.0.1:34578
2013-10-31 18:45:36,145 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51868, dest: /127.0.0.1:34578, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5380214336378028840_1387, duration: 213085
2013-10-31 18:45:36,145 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,146 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45064, dest: /127.0.0.1:59471, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5380214336378028840_1387, duration: 972624
2013-10-31 18:45:36,146 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,147 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48954, dest: /127.0.0.1:37740, bytes: 27352, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5380214336378028840_1387, duration: 1843332
2013-10-31 18:45:36,147 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5380214336378028840_1387 terminating
2013-10-31 18:45:36,149 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,149 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml from client DFSClient_-1107235254
2013-10-31 18:45:36,150 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_conf.xml is closed by DFSClient_-1107235254
2013-10-31 18:45:36,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,150 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5380214336378028840_1387 size 27352
2013-10-31 18:45:36,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:36,164 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken. blk_-1757874773394060354_1388
2013-10-31 18:45:36,166 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:45066 dest: /127.0.0.1:59471
2013-10-31 18:45:36,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:49241 dest: /127.0.0.1:54365
2013-10-31 18:45:36,169 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1757874773394060354_1388 src: /127.0.0.1:51871 dest: /127.0.0.1:34578
2013-10-31 18:45:36,172 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51871, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 69571
2013-10-31 18:45:36,172 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,172 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,173 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49241, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 850399
2013-10-31 18:45:36,173 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,173 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,174 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45066, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1757874773394060354_1388, duration: 1694015
2013-10-31 18:45:36,174 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1757874773394060354_1388 size 116
2013-10-31 18:45:36,174 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1757874773394060354_1388 terminating
2013-10-31 18:45:36,178 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:36,179 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:36,185 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken
2013-10-31 18:45:36,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.splitmetainfo dst=null perm=null
2013-10-31 18:45:36,189 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51872, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4117612380754601010_1384, duration: 281317
2013-10-31 18:45:36,190 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0038 = 1449. Number of splits = 4
2013-10-31 18:45:36,190 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,191 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,192 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0038_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:36,193 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0038 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:36,194 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0038 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:45:36,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8554828205108058155_1371 file build/test/data/dfs/data/data8/current/blk_-8554828205108058155 for deletion
2013-10-31 18:45:36,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2128509859462032642_1372 file build/test/data/dfs/data/data7/current/blk_-2128509859462032642 for deletion
2013-10-31 18:45:36,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8554828205108058155_1371 at file build/test/data/dfs/data/data8/current/blk_-8554828205108058155
2013-10-31 18:45:36,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1951060055773038883_1373 file build/test/data/dfs/data/data8/current/blk_-1951060055773038883 for deletion
2013-10-31 18:45:36,490 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2128509859462032642_1372 at file build/test/data/dfs/data/data7/current/blk_-2128509859462032642
2013-10-31 18:45:36,491 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1951060055773038883_1373 at file build/test/data/dfs/data/data8/current/blk_-1951060055773038883
2013-10-31 18:45:36,491 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4969057808391450845_1370 file build/test/data/dfs/data/data7/current/blk_4969057808391450845 for deletion
2013-10-31 18:45:36,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4969057808391450845_1370 at file build/test/data/dfs/data/data7/current/blk_4969057808391450845
2013-10-31 18:45:36,982 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0038_m_000005_0' to tip task_20131031182606197_0038_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:36,986 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000000_0'
2013-10-31 18:45:36,986 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000005_0'
2013-10-31 18:45:36,989 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:45:36,989 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000005_0 which needs 1 slots
2013-10-31 18:45:36,989 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000005_0 which needs 1 slots
2013-10-31 18:45:36,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken dst=null perm=null
2013-10-31 18:45:36,997 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51873, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 266220
2013-10-31 18:45:37,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=null
2013-10-31 18:45:37,007 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49246, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-803009644, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 382199
2013-10-31 18:45:37,038 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:37,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=null
2013-10-31 18:45:37,066 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49247, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-803009644, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2859678223868609014_1382, duration: 1194577
2013-10-31 18:45:37,163 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0037_m_1315758328
2013-10-31 18:45:37,168 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6726 with signal TERM. Exit code 0
2013-10-31 18:45:37,168 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_-609775213
2013-10-31 18:45:37,169 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_-609775213 spawned.
2013-10-31 18:45:37,171 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000005_0/taskjvm.sh
2013-10-31 18:45:37,456 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:37,456 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:37,456 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:37,456 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1315758328 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:37,597 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:54365 to replicate blk_-2859678223868609014_1382 to datanode(s) 127.0.0.1:34578
2013-10-31 18:45:37,598 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5370586274571019240_1376
2013-10-31 18:45:37,598 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5370586274571019240_1376
2013-10-31 18:45:37,822 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000001_0'
2013-10-31 18:45:37,824 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0037_m_000003_0'
2013-10-31 18:45:38,245 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_-609775213 given task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:38,292 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188) Starting thread to transfer block blk_-2859678223868609014_1382 to 127.0.0.1:34578
2013-10-31 18:45:38,292 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data4/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:38,293 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data4/current/blk_5370586274571019240
2013-10-31 18:45:38,293 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:54365, storageID=DS-316833290-10.5.128.102-54365-1383243963561, infoPort=44582, ipcPort=48188):Transmitted block blk_-2859678223868609014_1382 to /127.0.0.1:34578
2013-10-31 18:45:38,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2859678223868609014_1382 src: /127.0.0.1:51878 dest: /127.0.0.1:34578
2013-10-31 18:45:38,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2859678223868609014_1382 src: /127.0.0.1:51878 dest: /127.0.0.1:34578 of size 238055
2013-10-31 18:45:38,301 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2859678223868609014_1382 size 238055
2013-10-31 18:45:38,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:39,021 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data6/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:39,021 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data6/current/blk_5370586274571019240
2013-10-31 18:45:39,871 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:39,871 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000004_0 not found in cache
2013-10-31 18:45:39,872 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000002_0 not found in cache
2013-10-31 18:45:39,872 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331539872
2013-10-31 18:45:40,599 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_5370586274571019240_1376
2013-10-31 18:45:40,610 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-1087900185 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:40,621 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6976 with signal TERM. Exit code 0
2013-10-31 18:45:41,171 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_1185596558 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:41,181 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7205 with signal TERM. Exit code 0
2013-10-31 18:45:41,686 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000005_0 0.0% setup
2013-10-31 18:45:41,689 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000005_0 is done.
2013-10-31 18:45:41,690 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000005_0 was -1
2013-10-31 18:45:41,690 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:41,731 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:41,731 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:41,731 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:41,731 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1185596558 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:41,732 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:41,733 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:41,733 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:41,733 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-1087900185 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:41,989 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:41,990 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000000_0 not found in cache
2013-10-31 18:45:41,990 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331541990
2013-10-31 18:45:42,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5370586274571019240_1376 file build/test/data/dfs/data/data8/current/blk_5370586274571019240 for deletion
2013-10-31 18:45:42,492 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5370586274571019240_1376 at file build/test/data/dfs/data/data8/current/blk_5370586274571019240
2013-10-31 18:45:42,568 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-1272420910 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:42,578 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6840 with signal TERM. Exit code 0
2013-10-31 18:45:42,822 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:42,823 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000001_0 not found in cache
2013-10-31 18:45:42,823 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331542823
2013-10-31 18:45:42,825 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0037
2013-10-31 18:45:42,825 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0037_m_000003_0 not found in cache
2013-10-31 18:45:42,826 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0037 for user-log deletion with retainTimeStamp:1383331542826
2013-10-31 18:45:42,995 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000005_0' has completed task_20131031182606197_0038_m_000005 successfully.
2013-10-31 18:45:42,998 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000000_0' to tip task_20131031182606197_0038_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:45:43,000 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000000
2013-10-31 18:45:43,001 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:45:43,002 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000000_0 which needs 1 slots
2013-10-31 18:45:43,002 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000000_0 which needs 1 slots
2013-10-31 18:45:43,038 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_-1536865775
2013-10-31 18:45:43,039 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_-1536865775 spawned.
2013-10-31 18:45:43,043 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000000_0/taskjvm.sh
2013-10-31 18:45:43,275 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,275 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,275 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:43,276 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-1272420910 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,612 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_1256737587 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:43,613 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0037_m_-116763129 since job job_20131031182606197_0037 is dead
2013-10-31 18:45:43,618 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6963 with signal TERM. Exit code 0
2013-10-31 18:45:43,618 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group6974 with signal TERM. Exit code 0
2013-10-31 18:45:43,794 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,794 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,794 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:45:43,794 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:45:43,794 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:43,794 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:45:43,795 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_1256737587 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,795 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0037_m_-116763129 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:45:43,827 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000001_0' to tip task_20131031182606197_0038_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:45:43,828 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000001
2013-10-31 18:45:43,829 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:45:43,829 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000001_0 which needs 1 slots
2013-10-31 18:45:43,829 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000001_0 which needs 1 slots
2013-10-31 18:45:43,829 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000002_0' to tip task_20131031182606197_0038_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:45:43,829 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000002
2013-10-31 18:45:43,830 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:45:43,830 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000002_0 which needs 1 slots
2013-10-31 18:45:43,831 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000002_0 which needs 1 slots
2013-10-31 18:45:43,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken dst=null perm=null
2013-10-31 18:45:43,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken dst=null perm=null
2013-10-31 18:45:43,833 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49251, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 136502
2013-10-31 18:45:43,834 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51881, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1757874773394060354_1388, duration: 149760
2013-10-31 18:45:43,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=null
2013-10-31 18:45:43,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=null
2013-10-31 18:45:43,838 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45081, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-1205205789, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 167193
2013-10-31 18:45:43,839 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49256, bytes: 27503, op: HDFS_READ, cliID: DFSClient_-163024132, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5343639107369864272_1385, duration: 183178
2013-10-31 18:45:43,853 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,853 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=null
2013-10-31 18:45:43,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=null
2013-10-31 18:45:43,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51886, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-163024132, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 678736
2013-10-31 18:45:43,869 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51887, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1205205789, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 645600
2013-10-31 18:45:43,877 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0038_m_000003_0' to tip task_20131031182606197_0038_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:43,877 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0038_m_000003
2013-10-31 18:45:43,878 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:45:43,878 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000003_0 which needs 1 slots
2013-10-31 18:45:43,878 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000003_0 which needs 1 slots
2013-10-31 18:45:43,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038/jobToken dst=null perm=null
2013-10-31 18:45:43,882 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49259, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-1757874773394060354_1388, duration: 135166
2013-10-31 18:45:43,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.xml dst=null perm=null
2013-10-31 18:45:43,886 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45087, bytes: 27503, op: HDFS_READ, cliID: DFSClient_333977631, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5343639107369864272_1385, duration: 154969
2013-10-31 18:45:43,908 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:45:43,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.jar dst=null perm=null
2013-10-31 18:45:43,925 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51892, bytes: 239915, op: HDFS_READ, cliID: DFSClient_333977631, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2859678223868609014_1382, duration: 859871
2013-10-31 18:45:43,932 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_2065125206
2013-10-31 18:45:43,932 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_2065125206 spawned.
2013-10-31 18:45:43,933 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000001_0/taskjvm.sh
2013-10-31 18:45:43,941 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_106058079
2013-10-31 18:45:43,942 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_106058079 spawned.
2013-10-31 18:45:43,943 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000002_0/taskjvm.sh
2013-10-31 18:45:44,074 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_-1536865775 given task: attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:44,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=null
2013-10-31 18:45:44,584 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48982, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 162459
2013-10-31 18:45:44,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:44,623 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49266, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 1024, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 307496
2013-10-31 18:45:46,823 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_1344289597
2013-10-31 18:45:46,824 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_1344289597 spawned.
2013-10-31 18:45:46,826 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000003_0/taskjvm.sh
2013-10-31 18:45:47,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:47,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:47,406 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000. blk_110430402879847484_1389
2013-10-31 18:45:47,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:49268 dest: /127.0.0.1:54365
2013-10-31 18:45:47,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:51898 dest: /127.0.0.1:34578
2013-10-31 18:45:47,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_110430402879847484_1389 src: /127.0.0.1:48987 dest: /127.0.0.1:37740
2013-10-31 18:45:47,452 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:48987, dest: /127.0.0.1:37740, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_110430402879847484_1389, duration: 1371199
2013-10-31 18:45:47,452 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,453 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51898, dest: /127.0.0.1:34578, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_110430402879847484_1389, duration: 1589200
2013-10-31 18:45:47,453 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,454 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49268, dest: /127.0.0.1:54365, bytes: 181, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 2477799
2013-10-31 18:45:47,455 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_110430402879847484_1389 terminating
2013-10-31 18:45:47,458 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,458 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:47,459 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:47,459 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_110430402879847484_1389 size 181
2013-10-31 18:45:47,522 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:47,522 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 0.0%
2013-10-31 18:45:48,002 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:48,002 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0038_m_000005_0
2013-10-31 18:45:48,002 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000005_0 not found in cache
2013-10-31 18:45:48,564 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_2065125206 given task: attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:48,714 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_106058079 given task: attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:48,720 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_1344289597 given task: attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,006 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000000_0
2013-10-31 18:45:49,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=null
2013-10-31 18:45:49,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48992, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7884357659738796485_1383, duration: 161310
2013-10-31 18:45:49,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:49,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=null
2013-10-31 18:45:49,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038/job.split dst=null perm=null
2013-10-31 18:45:49,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45104, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7884357659738796485_1383, duration: 129031
2013-10-31 18:45:49,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49279, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7884357659738796485_1383, duration: 177692
2013-10-31 18:45:49,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:49,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:45:49,248 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51909, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 175400
2013-10-31 18:45:49,249 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:48998, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 163092
2013-10-31 18:45:49,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,294 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49282, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 176765
2013-10-31 18:45:49,298 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001. blk_-9113595780919189392_1392
2013-10-31 18:45:49,322 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:49000 dest: /127.0.0.1:37740
2013-10-31 18:45:49,323 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:49284 dest: /127.0.0.1:54365
2013-10-31 18:45:49,324 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-9113595780919189392_1392 src: /127.0.0.1:51914 dest: /127.0.0.1:34578
2013-10-31 18:45:49,326 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51914, dest: /127.0.0.1:34578, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-9113595780919189392_1392, duration: 1111857
2013-10-31 18:45:49,326 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,326 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49284, dest: /127.0.0.1:54365, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9113595780919189392_1392, duration: 1513577
2013-10-31 18:45:49,327 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,327 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,327 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49000, dest: /127.0.0.1:37740, bytes: 134, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9113595780919189392_1392, duration: 2016916
2013-10-31 18:45:49,327 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-9113595780919189392_1392 terminating
2013-10-31 18:45:49,328 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,328 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,330 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,331 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-9113595780919189392_1392 size 134
2013-10-31 18:45:49,428 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003. blk_3848946410901273249_1392
2013-10-31 18:45:49,431 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,431 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:45112 dest: /127.0.0.1:59471
2013-10-31 18:45:49,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:49287 dest: /127.0.0.1:54365
2013-10-31 18:45:49,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3848946410901273249_1392 src: /127.0.0.1:51917 dest: /127.0.0.1:34578
2013-10-31 18:45:49,455 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51917, dest: /127.0.0.1:34578, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3848946410901273249_1392, duration: 1334361
2013-10-31 18:45:49,455 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49287, dest: /127.0.0.1:54365, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3848946410901273249_1392, duration: 1498219
2013-10-31 18:45:49,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,456 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45112, dest: /127.0.0.1:59471, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0038_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3848946410901273249_1392, duration: 1906836
2013-10-31 18:45:49,456 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,456 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3848946410901273249_1392 terminating
2013-10-31 18:45:49,457 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,457 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:49,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,460 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3848946410901273249_1392 size 180
2013-10-31 18:45:49,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0 dst=null perm=null
2013-10-31 18:45:49,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:49,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:49,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000000_0 dst=null perm=null
2013-10-31 18:45:49,705 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,705 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000003_0 0.0%
2013-10-31 18:45:49,706 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,706 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000001_0 0.0%
2013-10-31 18:45:49,707 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0038_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:45:49,707 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000002_0 0.0%
2013-10-31 18:45:49,833 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000001_0
2013-10-31 18:45:49,837 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000002_0
2013-10-31 18:45:49,885 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0038_m_000003_0
2013-10-31 18:45:50,560 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:50,563 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:45:50,564 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000000_0 is done.
2013-10-31 18:45:50,564 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000000_0 was -1
2013-10-31 18:45:50,564 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:50,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0 dst=null perm=null
2013-10-31 18:45:50,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0 dst=null perm=null
2013-10-31 18:45:50,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0 dst=null perm=null
2013-10-31 18:45:50,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:50,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:50,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000003_0 dst=null perm=null
2013-10-31 18:45:50,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000001_0 dst=null perm=null
2013-10-31 18:45:50,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary/_attempt_20131031182606197_0038_m_000002_0 dst=null perm=null
2013-10-31 18:45:52,002 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:45:52,004 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000001_0 is done.
2013-10-31 18:45:52,004 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000001_0 was -1
2013-10-31 18:45:52,005 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,010 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000000_0' has completed task_20131031182606197_0038_m_000000 successfully.
2013-10-31 18:45:52,134 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:45:52,134 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:45:52,134 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000003_0 is done.
2013-10-31 18:45:52,134 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000003_0 was -1
2013-10-31 18:45:52,135 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,135 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000002_0 is done.
2013-10-31 18:45:52,135 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000002_0 was -1
2013-10-31 18:45:52,135 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:52,836 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000001_0' has completed task_20131031182606197_0038_m_000001 successfully.
2013-10-31 18:45:52,841 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000002_0' has completed task_20131031182606197_0038_m_000002 successfully.
2013-10-31 18:45:52,889 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000003_0' has completed task_20131031182606197_0038_m_000003 successfully.
2013-10-31 18:45:52,892 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0038_m_000004_0' to tip task_20131031182606197_0038_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:45:52,894 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0038_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:45:52,894 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0038_m_000004_0 which needs 1 slots
2013-10-31 18:45:52,895 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0038_m_000004_0 which needs 1 slots
2013-10-31 18:45:52,924 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0038_m_963364654
2013-10-31 18:45:52,925 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0038_m_963364654 spawned.
2013-10-31 18:45:52,926 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0038/attempt_20131031182606197_0038_m_000004_0/taskjvm.sh
2013-10-31 18:45:53,839 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0038_m_963364654 given task: attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,352 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000004_0 0.0%
2013-10-31 18:45:54,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary dst=null perm=null
2013-10-31 18:45:54,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:54,372 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS from client DFSClient_attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,372 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0038_m_000004_0
2013-10-31 18:45:54,377 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,378 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,378 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,378 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2859678223868609014 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,378 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,378 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7884357659738796485 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-4117612380754601010 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:54,379 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:54,380 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:54,380 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5343639107369864272 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:45:54,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0038 dst=null perm=null
2013-10-31 18:45:55,601 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_-4117612380754601010_1384
2013-10-31 18:45:55,601 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385 blk_-4117612380754601010_1384
2013-10-31 18:45:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:45:56,018 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,023 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,028 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,034 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,039 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,044 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:45:56,044 INFO metrics.MetricsSaver (?:flush(?)) - Discard 34 records
2013-10-31 18:45:57,282 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0038_m_000004_0 0.0% cleanup
2013-10-31 18:45:57,283 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0038_m_000004_0 is done.
2013-10-31 18:45:57,284 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0038_m_000004_0 was -1
2013-10-31 18:45:57,284 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:45:57,424 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data2/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:57,424 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data1/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:57,424 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data2/current/blk_-4117612380754601010
2013-10-31 18:45:57,424 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data1/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:57,425 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data1/current/blk_-2859678223868609014
2013-10-31 18:45:57,425 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data1/current/blk_7884357659738796485
2013-10-31 18:45:57,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data7/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:57,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data7/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:57,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data7/current/blk_-4117612380754601010
2013-10-31 18:45:57,497 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data8/current/blk_5343639107369864272 for deletion
2013-10-31 18:45:57,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data7/current/blk_-2859678223868609014
2013-10-31 18:45:57,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data8/current/blk_5343639107369864272
2013-10-31 18:45:57,498 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data8/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:57,499 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data8/current/blk_7884357659738796485
2013-10-31 18:45:58,602 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385 blk_-4117612380754601010_1384
2013-10-31 18:45:58,602 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_7884357659738796485_1383 blk_-2859678223868609014_1382 blk_5343639107369864272_1385
2013-10-31 18:45:58,902 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0038_m_000004_0' has completed task_20131031182606197_0038_m_000004 successfully.
2013-10-31 18:45:58,903 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0038 has completed successfully.
2013-10-31 18:45:58,903 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0038,submitTime=1383245135562,launchTime=1383245136193,firstMapTaskLaunchTime=1383245142998,firstJobSetupTaskLaunchTime=1383245136981,firstJobCleanupTaskLaunchTime=1383245152891,finishTime=1383245158903,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=38,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[A1E0C7E2D50043E7A70CE6FEC20990D1/5AAB0AA1743442EC8518B72A4DC74B9A] test/(1/1) ...eldedpipesplatform/filter
2013-10-31 18:45:58,908 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC. blk_-4756814230616005261_1393
2013-10-31 18:45:58,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:49010 dest: /127.0.0.1:37740
2013-10-31 18:45:58,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:45120 dest: /127.0.0.1:59471
2013-10-31 18:45:58,914 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-4756814230616005261_1393 src: /127.0.0.1:51924 dest: /127.0.0.1:34578
2013-10-31 18:45:58,919 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51924, dest: /127.0.0.1:34578, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-4756814230616005261_1393, duration: 95129
2013-10-31 18:45:58,919 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,920 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45120, dest: /127.0.0.1:59471, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-4756814230616005261_1393, duration: 2866011
2013-10-31 18:45:58,920 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,921 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49010, dest: /127.0.0.1:37740, bytes: 22363, op: HDFS_WRITE, cliID: DFSClient_-1107235254, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-4756814230616005261_1393, duration: 3744366
2013-10-31 18:45:58,921 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-4756814230616005261_1393 terminating
2013-10-31 18:45:58,921 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,925 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,925 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-4756814230616005261_1393 size 22363
2013-10-31 18:45:58,926 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC from client DFSClient_-1107235254
2013-10-31 18:45:58,926 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_logs/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC is closed by DFSClient_-1107235254
2013-10-31 18:45:58,933 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0038_1383245135562_hadoop_%5BA1E0C7E2D50043E7A70CE6FEC20990D1%2F5AAB0AA1743442EC to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:58,934 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000003_0'
2013-10-31 18:45:58,934 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000004_0'
2013-10-31 18:45:58,936 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:45:58,936 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:45:58,936 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1757874773394060354 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:45:58,941 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0038_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:45:58,942 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/_temporary
2013-10-31 18:45:58,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0038 dst=null perm=null
2013-10-31 18:45:58,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=null
2013-10-31 18:45:59,000 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:45:59,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000 dst=null perm=null
2013-10-31 18:45:59,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001 dst=null perm=null
2013-10-31 18:45:59,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002 dst=null perm=null
2013-10-31 18:45:59,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003 dst=null perm=null
2013-10-31 18:45:59,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000 dst=null perm=null
2013-10-31 18:45:59,009 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49297, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 280147
2013-10-31 18:45:59,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001 dst=null perm=null
2013-10-31 18:45:59,012 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49015, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-9113595780919189392_1392, duration: 261782
2013-10-31 18:45:59,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002 dst=null perm=null
2013-10-31 18:45:59,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003 dst=null perm=null
2013-10-31 18:45:59,017 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49299, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3848946410901273249_1392, duration: 254037
2013-10-31 18:45:59,017 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/filter
2013-10-31 18:45:59,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter dst=null perm=null
2013-10-31 18:45:59,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00000 dst=null perm=null
2013-10-31 18:45:59,025 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49300, bytes: 185, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_110430402879847484_1389, duration: 253223
2013-10-31 18:45:59,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00001 dst=null perm=null
2013-10-31 18:45:59,029 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49301, bytes: 138, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-9113595780919189392_1392, duration: 254569
2013-10-31 18:45:59,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00002 dst=null perm=null
2013-10-31 18:45:59,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/filter/part-00003 dst=null perm=null
2013-10-31 18:45:59,036 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51931, bytes: 184, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3848946410901273249_1392, duration: 253479
2013-10-31 18:45:59,056 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:45:59,057 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:45:59,068 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] starting
2013-10-31 18:45:59,069 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] source: MultiSourceTap[2:[Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt"], Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt"]]]
2013-10-31 18:45:59,069 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat"]
2013-10-31 18:45:59,069 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] parallel execution is enabled: true
2013-10-31 18:45:59,070 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] starting jobs: 1
2013-10-31 18:45:59,070 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [concat] allocating threads: 1
2013-10-31 18:45:59,071 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [concat] starting step: (1/1) ...pesplatform/complexconcat
2013-10-31 18:45:59,074 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:45:59,074 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:45:59,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:45:59,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:45:59,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,241 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar. blk_-1986585353932177665_1394
2013-10-31 18:45:59,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:51932 dest: /127.0.0.1:34578
2013-10-31 18:45:59,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:45130 dest: /127.0.0.1:59471
2013-10-31 18:45:59,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:49022 dest: /127.0.0.1:37740
2013-10-31 18:45:59,254 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49022, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-1986585353932177665_1394, duration: 3956099
2013-10-31 18:45:59,254 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,255 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,255 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45130, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 5218053
2013-10-31 18:45:59,255 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,255 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,256 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51932, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1986585353932177665_1394, duration: 5952189
2013-10-31 18:45:59,256 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-1986585353932177665_1394 terminating
2013-10-31 18:45:59,258 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar from client DFSClient_-1596270109
2013-10-31 18:45:59,259 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:45:59,260 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:45:59,268 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar. New replication is 10
2013-10-31 18:45:59,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=null
2013-10-31 18:45:59,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,283 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:45:59,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 2
2013-10-31 18:45:59,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:45:59,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:45:59,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,299 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-4117612380754601010_1384 file build/test/data/dfs/data/data3/current/blk_-4117612380754601010 for deletion
2013-10-31 18:45:59,299 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data3/current/blk_-2859678223868609014 for deletion
2013-10-31 18:45:59,300 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-4117612380754601010_1384 at file build/test/data/dfs/data/data3/current/blk_-4117612380754601010
2013-10-31 18:45:59,300 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data4/current/blk_5343639107369864272 for deletion
2013-10-31 18:45:59,301 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data3/current/blk_-2859678223868609014
2013-10-31 18:45:59,301 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data4/current/blk_5343639107369864272
2013-10-31 18:45:59,301 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data4/current/blk_7884357659738796485 for deletion
2013-10-31 18:45:59,302 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data4/current/blk_7884357659738796485
2013-10-31 18:45:59,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,306 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split. New replication is 10
2013-10-31 18:45:59,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:45:59,314 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split. blk_1166790603136202975_1395
2013-10-31 18:45:59,316 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:51935 dest: /127.0.0.1:34578
2013-10-31 18:45:59,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:49024 dest: /127.0.0.1:37740
2013-10-31 18:45:59,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:45134 dest: /127.0.0.1:59471
2013-10-31 18:45:59,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1166790603136202975_1395 src: /127.0.0.1:49309 dest: /127.0.0.1:54365
2013-10-31 18:45:59,324 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49309, dest: /127.0.0.1:54365, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 115704
2013-10-31 18:45:59,324 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,325 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45134, dest: /127.0.0.1:59471, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 967846
2013-10-31 18:45:59,325 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,326 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49024, dest: /127.0.0.1:37740, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1166790603136202975_1395, duration: 2024220
2013-10-31 18:45:59,326 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,327 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,327 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51935, dest: /127.0.0.1:34578, bytes: 2077, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1166790603136202975_1395, duration: 2957022
2013-10-31 18:45:59,327 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,328 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_1166790603136202975_1395 terminating
2013-10-31 18:45:59,330 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,331 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split from client DFSClient_-1596270109
2013-10-31 18:45:59,331 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split is closed by DFSClient_-1596270109
2013-10-31 18:45:59,332 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1166790603136202975_1395 size 2077
2013-10-31 18:45:59,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,347 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo. blk_5434570261073731497_1396
2013-10-31 18:45:59,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:45136 dest: /127.0.0.1:59471
2013-10-31 18:45:59,350 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:51940 dest: /127.0.0.1:34578
2013-10-31 18:45:59,352 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5434570261073731497_1396 src: /127.0.0.1:49312 dest: /127.0.0.1:54365
2013-10-31 18:45:59,368 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49312, dest: /127.0.0.1:54365, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5434570261073731497_1396, duration: 759808
2013-10-31 18:45:59,369 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,370 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51940, dest: /127.0.0.1:34578, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5434570261073731497_1396, duration: 2841634
2013-10-31 18:45:59,374 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,374 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45136, dest: /127.0.0.1:59471, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5434570261073731497_1396, duration: 6655673
2013-10-31 18:45:59,374 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,375 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5434570261073731497_1396 terminating
2013-10-31 18:45:59,376 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,377 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:45:59,377 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:45:59,378 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5434570261073731497_1396 size 218
2013-10-31 18:45:59,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,401 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml. blk_7343258894093907583_1397
2013-10-31 18:45:59,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:49030 dest: /127.0.0.1:37740
2013-10-31 18:45:59,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:51943 dest: /127.0.0.1:34578
2013-10-31 18:45:59,406 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7343258894093907583_1397 src: /127.0.0.1:45141 dest: /127.0.0.1:59471
2013-10-31 18:45:59,409 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45141, dest: /127.0.0.1:59471, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7343258894093907583_1397, duration: 285912
2013-10-31 18:45:59,410 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,410 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51943, dest: /127.0.0.1:34578, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7343258894093907583_1397, duration: 1147468
2013-10-31 18:45:59,410 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,411 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49030, dest: /127.0.0.1:37740, bytes: 28208, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 2108270
2013-10-31 18:45:59,411 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,411 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7343258894093907583_1397 terminating
2013-10-31 18:45:59,416 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,416 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml from client DFSClient_-1596270109
2013-10-31 18:45:59,417 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:45:59,417 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7343258894093907583_1397 size 28208
2013-10-31 18:45:59,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=null
2013-10-31 18:45:59,431 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49034, bytes: 28432, op: HDFS_READ, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 390593
2013-10-31 18:45:59,450 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0039: nMaps=6 nReduces=1 max=-1
2013-10-31 18:45:59,450 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0039 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:45:59,450 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0039
2013-10-31 18:45:59,450 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0039 RESULT=SUCCESS
2013-10-31 18:45:59,451 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0039
2013-10-31 18:45:59,452 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [concat] submitted hadoop job: job_20131031182606197_0039
2013-10-31 18:45:59,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,484 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml. blk_-2129735822278363250_1399
2013-10-31 18:45:59,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:51947 dest: /127.0.0.1:34578
2013-10-31 18:45:59,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:45145 dest: /127.0.0.1:59471
2013-10-31 18:45:59,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2129735822278363250_1399 src: /127.0.0.1:49320 dest: /127.0.0.1:54365
2013-10-31 18:45:59,493 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49320, dest: /127.0.0.1:54365, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2129735822278363250_1399, duration: 667990
2013-10-31 18:45:59,493 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,494 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45145, dest: /127.0.0.1:59471, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2129735822278363250_1399, duration: 1474047
2013-10-31 18:45:59,494 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,495 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:51947, dest: /127.0.0.1:34578, bytes: 28273, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2129735822278363250_1399, duration: 2508767
2013-10-31 18:45:59,495 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2129735822278363250_1399 terminating
2013-10-31 18:45:59,498 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,498 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml from client DFSClient_-1631050623
2013-10-31 18:45:59,499 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_conf.xml is closed by DFSClient_-1631050623
2013-10-31 18:45:59,499 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,500 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2129735822278363250_1399 size 28273
2013-10-31 18:45:59,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:45:59,781 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken. blk_4955026965077948598_1400
2013-10-31 18:45:59,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:49038 dest: /127.0.0.1:37740
2013-10-31 18:45:59,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:45148 dest: /127.0.0.1:59471
2013-10-31 18:45:59,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4955026965077948598_1400 src: /127.0.0.1:49323 dest: /127.0.0.1:54365
2013-10-31 18:45:59,789 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49323, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4955026965077948598_1400, duration: 596903
2013-10-31 18:45:59,789 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,790 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45148, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 1366568
2013-10-31 18:45:59,790 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,790 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,791 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49038, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4955026965077948598_1400, duration: 2252022
2013-10-31 18:45:59,791 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4955026965077948598_1400 terminating
2013-10-31 18:45:59,793 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,794 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken from client DFSClient_-1596270109
2013-10-31 18:45:59,794 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:45:59,795 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4955026965077948598_1400 size 116
2013-10-31 18:45:59,800 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken
2013-10-31 18:45:59,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.splitmetainfo dst=null perm=null
2013-10-31 18:45:59,804 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49324, bytes: 222, op: HDFS_READ, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5434570261073731497_1396, duration: 266116
2013-10-31 18:45:59,806 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0039 = 38. Number of splits = 6
2013-10-31 18:45:59,806 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,806 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,807 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,808 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,809 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000004 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,810 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0039_m_000005 has split on node:/default-rack/127.0.0.1
2013-10-31 18:45:59,811 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0039 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:45:59,811 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0039 initialized successfully with 6 map tasks and 1 reduce tasks.
2013-10-31 18:46:00,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2859678223868609014_1382 file build/test/data/dfs/data/data5/current/blk_-2859678223868609014 for deletion
2013-10-31 18:46:00,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5343639107369864272_1385 file build/test/data/dfs/data/data5/current/blk_5343639107369864272 for deletion
2013-10-31 18:46:00,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2859678223868609014_1382 at file build/test/data/dfs/data/data5/current/blk_-2859678223868609014
2013-10-31 18:46:00,028 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7884357659738796485_1383 file build/test/data/dfs/data/data6/current/blk_7884357659738796485 for deletion
2013-10-31 18:46:00,029 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5343639107369864272_1385 at file build/test/data/dfs/data/data5/current/blk_5343639107369864272
2013-10-31 18:46:00,029 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7884357659738796485_1383 at file build/test/data/dfs/data/data6/current/blk_7884357659738796485
2013-10-31 18:46:01,024 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0039_m_000007_0' to tip task_20131031182606197_0039_m_000007, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:01,032 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000000_0'
2013-10-31 18:46:01,033 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000005_0'
2013-10-31 18:46:01,034 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000007_0 task's state:UNASSIGNED
2013-10-31 18:46:01,035 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000007_0 which needs 1 slots
2013-10-31 18:46:01,035 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000007_0 which needs 1 slots
2013-10-31 18:46:01,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken dst=null perm=null
2013-10-31 18:46:01,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49042, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4955026965077948598_1400, duration: 300794
2013-10-31 18:46:01,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=null
2013-10-31 18:46:01,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49044, bytes: 28432, op: HDFS_READ, cliID: DFSClient_-400017871, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 376435
2013-10-31 18:46:01,087 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:01,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=null
2013-10-31 18:46:01,110 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45154, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-400017871, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 600067
2013-10-31 18:46:01,167 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0038_m_-609775213
2013-10-31 18:46:01,173 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7370 with signal TERM. Exit code 0
2013-10-31 18:46:01,173 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:01,174 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_902584542 spawned.
2013-10-31 18:46:01,175 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000007_0/taskjvm.sh
2013-10-31 18:46:01,404 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:01,404 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:01,404 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:01,404 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_-609775213 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:01,603 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_-1986585353932177665_1394 to datanode(s) 127.0.0.1:54365
2013-10-31 18:46:01,603 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-1757874773394060354_1388
2013-10-31 18:46:01,603 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-1757874773394060354_1388
2013-10-31 18:46:01,847 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000001_0'
2013-10-31 18:46:01,851 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0038_m_000002_0'
2013-10-31 18:46:02,104 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_902584542 given task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:02,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:03,029 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data5/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:03,029 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data5/current/blk_-1757874773394060354
2013-10-31 18:46:03,426 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_-1986585353932177665_1394 to 127.0.0.1:54365
2013-10-31 18:46:03,426 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data2/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:03,427 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data2/current/blk_-1757874773394060354
2013-10-31 18:46:03,428 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-1986585353932177665_1394 src: /127.0.0.1:49331 dest: /127.0.0.1:54365
2013-10-31 18:46:03,428 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_-1986585353932177665_1394 to /127.0.0.1:54365
2013-10-31 18:46:03,431 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-1986585353932177665_1394 src: /127.0.0.1:49331 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:46:03,436 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-1986585353932177665_1394 size 238055
2013-10-31 18:46:03,936 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:03,936 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000004_0 not found in cache
2013-10-31 18:46:03,937 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000003_0 not found in cache
2013-10-31 18:46:03,937 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331563937
2013-10-31 18:46:04,604 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_-1757874773394060354_1388
2013-10-31 18:46:04,685 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_1344289597 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:04,696 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7663 with signal TERM. Exit code 0
2013-10-31 18:46:04,893 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:04,894 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:04,894 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:04,894 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_1344289597 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:05,301 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1757874773394060354_1388 file build/test/data/dfs/data/data3/current/blk_-1757874773394060354 for deletion
2013-10-31 18:46:05,301 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1757874773394060354_1388 at file build/test/data/dfs/data/data3/current/blk_-1757874773394060354
2013-10-31 18:46:05,353 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_963364654 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:05,362 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7833 with signal TERM. Exit code 0
2013-10-31 18:46:05,540 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:05,540 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:05,540 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:05,540 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_963364654 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:05,552 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000007_0 0.0% setup
2013-10-31 18:46:05,555 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000007_0 is done.
2013-10-31 18:46:05,555 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000007_0 was -1
2013-10-31 18:46:05,555 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:06,035 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,036 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000000_0 not found in cache
2013-10-31 18:46:06,036 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566036
2013-10-31 18:46:06,108 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_-1536865775 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:06,118 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7477 with signal TERM. Exit code 0
2013-10-31 18:46:06,316 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:06,317 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:06,317 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:06,317 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_-1536865775 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:06,848 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,848 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000001_0 not found in cache
2013-10-31 18:46:06,848 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566848
2013-10-31 18:46:06,851 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0038
2013-10-31 18:46:06,852 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0038_m_000002_0 not found in cache
2013-10-31 18:46:06,852 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0038 for user-log deletion with retainTimeStamp:1383331566852
2013-10-31 18:46:07,041 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000007_0' has completed task_20131031182606197_0039_m_000007 successfully.
2013-10-31 18:46:07,045 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000000_0' to tip task_20131031182606197_0039_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:07,046 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000000
2013-10-31 18:46:07,047 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000001_0' to tip task_20131031182606197_0039_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:07,047 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000001
2013-10-31 18:46:07,049 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:07,050 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:46:07,050 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000000_0 which needs 1 slots
2013-10-31 18:46:07,050 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000000_0 which needs 1 slots
2013-10-31 18:46:07,051 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000001_0 which needs 1 slots
2013-10-31 18:46:07,051 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000001_0 which needs 1 slots
2013-10-31 18:46:07,084 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_1010047912
2013-10-31 18:46:07,085 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_1010047912 spawned.
2013-10-31 18:46:07,086 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0039/attempt_20131031182606197_0039_m_000000_0. Attempting to reuse: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:07,089 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000001_0/taskjvm.sh
2013-10-31 18:46:07,110 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_902584542 given task: attempt_20131031182606197_0039_m_000000_0
2013-10-31 18:46:07,135 INFO mapred.JobTracker (JobTracker.java:run(373)) - attempt_20131031182606197_0039_m_000000_0 is 88 ms debug.
2013-10-31 18:46:07,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:07,266 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49333, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 165557
2013-10-31 18:46:07,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:46:07,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49334, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4102379777415512644_1030, duration: 130524
2013-10-31 18:46:07,576 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_2065125206 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:07,581 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7628 with signal TERM. Exit code 0
2013-10-31 18:46:07,686 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0038_m_106058079 since job job_20131031182606197_0038 is dead
2013-10-31 18:46:07,691 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7664 with signal TERM. Exit code 0
2013-10-31 18:46:07,739 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:07,739 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:07,739 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:07,739 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_2065125206 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:07,853 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000002_0' to tip task_20131031182606197_0039_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:07,854 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000002
2013-10-31 18:46:07,854 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000003_0' to tip task_20131031182606197_0039_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:07,854 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000003
2013-10-31 18:46:07,855 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:46:07,855 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:46:07,856 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000002_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000002_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000003_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000003_0 which needs 1 slots
2013-10-31 18:46:07,856 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000004_0' to tip task_20131031182606197_0039_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:07,857 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000004
2013-10-31 18:46:07,857 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0039_m_000005_0' to tip task_20131031182606197_0039_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:07,857 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0039_m_000005
2013-10-31 18:46:07,858 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:46:07,859 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:46:07,859 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000004_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken dst=null perm=null
2013-10-31 18:46:07,859 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000004_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000005_0 which needs 1 slots
2013-10-31 18:46:07,859 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 1 and trying to launch attempt_20131031182606197_0039_m_000005_0 which needs 1 slots
2013-10-31 18:46:07,861 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45162, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 182201
2013-10-31 18:46:07,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039/jobToken dst=null perm=null
2013-10-31 18:46:07,863 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45164, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4955026965077948598_1400, duration: 126943
2013-10-31 18:46:07,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=null
2013-10-31 18:46:07,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.xml dst=null perm=null
2013-10-31 18:46:07,866 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51969, bytes: 28432, op: HDFS_READ, cliID: DFSClient_1085241453, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7343258894093907583_1397, duration: 154454
2013-10-31 18:46:07,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49058, bytes: 28432, op: HDFS_READ, cliID: DFSClient_1917658636, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7343258894093907583_1397, duration: 165504
2013-10-31 18:46:07,879 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:07,879 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:07,881 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:07,881 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:07,881 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:07,881 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0038_m_106058079 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:07,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=null
2013-10-31 18:46:07,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.jar dst=null perm=null
2013-10-31 18:46:07,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:51972, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1917658636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-1986585353932177665_1394, duration: 731867
2013-10-31 18:46:07,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45168, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1085241453, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-1986585353932177665_1394, duration: 710125
2013-10-31 18:46:07,954 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1010047912 given task: attempt_20131031182606197_0039_m_000001_0
2013-10-31 18:46:07,963 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_1519844982
2013-10-31 18:46:07,964 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_1519844982 spawned.
2013-10-31 18:46:07,964 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-204099648
2013-10-31 18:46:07,964 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-387027469
2013-10-31 18:46:07,964 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-204099648 spawned.
2013-10-31 18:46:07,965 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-387027469 spawned.
2013-10-31 18:46:07,966 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_m_-1608983854
2013-10-31 18:46:07,966 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000003_0/taskjvm.sh
2013-10-31 18:46:07,967 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_m_-1608983854 spawned.
2013-10-31 18:46:07,967 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000002_0/taskjvm.sh
2013-10-31 18:46:07,968 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000004_0/taskjvm.sh
2013-10-31 18:46:07,968 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_m_000005_0/taskjvm.sh
2013-10-31 18:46:09,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:09,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45171, bytes: 2097, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 174407
2013-10-31 18:46:09,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:46:09,209 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45172, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4102379777415512644_1030, duration: 135769
2013-10-31 18:46:09,605 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-387027469 given task: attempt_20131031182606197_0039_m_000002_0
2013-10-31 18:46:09,609 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-204099648 given task: attempt_20131031182606197_0039_m_000004_0
2013-10-31 18:46:09,610 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_-1608983854 given task: attempt_20131031182606197_0039_m_000005_0
2013-10-31 18:46:09,612 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1519844982 given task: attempt_20131031182606197_0039_m_000003_0
2013-10-31 18:46:10,116 INFO security.ShellBasedUnixGroupsMapping (ShellBasedUnixGroupsMapping.java:getUnixGroups(89)) - add hadoop to shell userGroupsCache
2013-10-31 18:46:10,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:10,123 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45181, bytes: 549, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000005_0, offset: 1536, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 157856
2013-10-31 18:46:10,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:10,138 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49356, bytes: 1581, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_1166790603136202975_1395, duration: 144528
2013-10-31 18:46:10,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:10,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039/job.split dst=null perm=null
2013-10-31 18:46:10,147 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45183, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000004_0, offset: 1024, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1166790603136202975_1395, duration: 268355
2013-10-31 18:46:10,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49075, bytes: 1065, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1166790603136202975_1395, duration: 154450
2013-10-31 18:46:10,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:46:10,164 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49076, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000005_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3135295757712174631_1031, duration: 135176
2013-10-31 18:46:10,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:46:10,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt dst=null perm=null
2013-10-31 18:46:10,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt dst=null perm=null
2013-10-31 18:46:10,191 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49077, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000004_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4102379777415512644_1030, duration: 136404
2013-10-31 18:46:10,192 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 108093
2013-10-31 18:46:10,217 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:0+9
2013-10-31 18:46:10,218 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000000_0 is done.
2013-10-31 18:46:10,218 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000000_0 was 57
2013-10-31 18:46:10,219 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:10,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49362, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0039_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3135295757712174631_1031, duration: 141527
2013-10-31 18:46:12,050 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:12,051 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0039_m_000007_0
2013-10-31 18:46:12,051 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0039_m_000007_0 not found in cache
2013-10-31 18:46:12,069 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:9+9
2013-10-31 18:46:12,072 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000001_0 is done.
2013-10-31 18:46:12,072 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000001_0 was 40
2013-10-31 18:46:12,073 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,048 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000005_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:18+1
2013-10-31 18:46:13,050 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000005_0 is done.
2013-10-31 18:46:13,051 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000005_0 was 6
2013-10-31 18:46:13,051 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:13,056 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000000_0' has completed task_20131031182606197_0039_m_000000 successfully.
2013-10-31 18:46:13,057 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000001_0' has completed task_20131031182606197_0039_m_000001 successfully.
2013-10-31 18:46:13,059 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0039_r_000000_0' to tip task_20131031182606197_0039_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:13,061 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:13,061 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:0+9
2013-10-31 18:46:13,061 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_r_000000_0 which needs 1 slots
2013-10-31 18:46:13,062 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_r_000000_0 which needs 1 slots
2013-10-31 18:46:13,064 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000002_0 is done.
2013-10-31 18:46:13,066 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000002_0 was 57
2013-10-31 18:46:13,066 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 1
2013-10-31 18:46:13,067 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000004_0 0.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/lower.txt:18+1
2013-10-31 18:46:13,069 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000004_0 is done.
2013-10-31 18:46:13,069 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000004_0 was 6
2013-10-31 18:46:13,070 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,073 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/upper.txt:9+9
2013-10-31 18:46:13,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000003_0 is done.
2013-10-31 18:46:13,076 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000003_0 was 40
2013-10-31 18:46:13,076 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:13,099 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0039_r_593026137
2013-10-31 18:46:13,099 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0039_r_593026137 spawned.
2013-10-31 18:46:13,101 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0039/attempt_20131031182606197_0039_r_000000_0/taskjvm.sh
2013-10-31 18:46:13,860 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000002_0' has completed task_20131031182606197_0039_m_000002 successfully.
2013-10-31 18:46:13,861 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000003_0' has completed task_20131031182606197_0039_m_000003 successfully.
2013-10-31 18:46:13,863 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000004_0' has completed task_20131031182606197_0039_m_000004 successfully.
2013-10-31 18:46:13,864 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000005_0' has completed task_20131031182606197_0039_m_000005 successfully.
2013-10-31 18:46:14,105 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_r_593026137 given task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:19,785 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43397, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000000_0, duration: 7078563
2013-10-31 18:46:19,796 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43397, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000001_0, duration: 5081805
2013-10-31 18:46:19,808 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41377, bytes: 57, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000002_0, duration: 9398972
2013-10-31 18:46:19,819 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41377, bytes: 40, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000003_0, duration: 7640272
2013-10-31 18:46:19,835 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46075, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000004_0, duration: 12364902
2013-10-31 18:46:19,851 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46075, bytes: 6, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0039_m_000005_0, duration: 11619097
2013-10-31 18:46:20,588 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,634 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,691 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:20,878 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2097 Total time for transactions(ms): 36Number of transactions batched in Syncs: 179 Number of syncs: 1475 SyncTimes(ms): 85716 20273
2013-10-31 18:46:20,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:20,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:20,909 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000. blk_3582165743761812411_1401
2013-10-31 18:46:20,943 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:49086 dest: /127.0.0.1:37740
2013-10-31 18:46:20,944 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:45196 dest: /127.0.0.1:59471
2013-10-31 18:46:20,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3582165743761812411_1401 src: /127.0.0.1:49371 dest: /127.0.0.1:54365
2013-10-31 18:46:20,947 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49371, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3582165743761812411_1401, duration: 1004123
2013-10-31 18:46:20,947 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,947 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,947 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45196, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3582165743761812411_1401, duration: 1385823
2013-10-31 18:46:20,950 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,951 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49086, dest: /127.0.0.1:37740, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0039_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3582165743761812411_1401, duration: 4420078
2013-10-31 18:46:20,951 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3582165743761812411_1401 terminating
2013-10-31 18:46:20,951 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,952 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3582165743761812411_1401 size 40
2013-10-31 18:46:20,953 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:20,954 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:20,990 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0039_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:46:20,990 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 0.33333334% reduce > copy (6 of 6 at 0.00 MB/s)
2013-10-31 18:46:22,072 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 6 OK for attempt_20131031182606197_0039_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:46:22,073 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:23,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0 dst=null perm=null
2013-10-31 18:46:23,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:23,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:23,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary/_attempt_20131031182606197_0039_r_000000_0 dst=null perm=null
2013-10-31 18:46:23,636 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 1.0% reduce > reduce
2013-10-31 18:46:23,638 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_r_000000_0 1.0% reduce > reduce
2013-10-31 18:46:23,639 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_r_000000_0 is done.
2013-10-31 18:46:23,639 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_r_000000_0 was -1
2013-10-31 18:46:23,639 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:24,646 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_7295626289958709819_1037
2013-10-31 18:46:25,077 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_r_000000_0' has completed task_20131031182606197_0039_r_000000 successfully.
2013-10-31 18:46:25,080 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0039_m_000006_0' to tip task_20131031182606197_0039_m_000006, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:25,084 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0039_m_000006_0 task's state:UNASSIGNED
2013-10-31 18:46:25,084 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0039_m_000006_0 which needs 1 slots
2013-10-31 18:46:25,084 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0039_m_000006_0 which needs 1 slots
2013-10-31 18:46:25,120 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0039/attempt_20131031182606197_0039_m_000006_0. Attempting to reuse: jvm_20131031182606197_0039_m_1010047912
2013-10-31 18:46:26,144 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0039_m_1010047912 given task: attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,273 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000006_0 0.0%
2013-10-31 18:46:26,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary dst=null perm=null
2013-10-31 18:46:26,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:26,291 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS from client DFSClient_attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,291 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0039_m_000006_0
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-1986585353932177665 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,296 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,297 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1166790603136202975 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,297 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:26,297 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,297 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5434570261073731497 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,297 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:26,298 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:46:26,298 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7343258894093907583 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:26,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0039 dst=null perm=null
2013-10-31 18:46:28,608 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_7343258894093907583_1397
2013-10-31 18:46:28,608 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_7343258894093907583_1397
2013-10-31 18:46:29,228 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0039_m_000006_0 0.0% cleanup
2013-10-31 18:46:29,230 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0039_m_000006_0 is done.
2013-10-31 18:46:29,230 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0039_m_000006_0 was -1
2013-10-31 18:46:29,231 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:30,084 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:30,085 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0039_r_000000_0
2013-10-31 18:46:30,435 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data2/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:30,435 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data1/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:30,436 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data2/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:30,436 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data1/current/blk_1166790603136202975
2013-10-31 18:46:30,436 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data1/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:30,436 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data2/current/blk_-1986585353932177665
2013-10-31 18:46:30,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data1/current/blk_7343258894093907583
2013-10-31 18:46:30,437 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data2/current/blk_5434570261073731497
2013-10-31 18:46:30,508 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data7/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:30,508 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data8/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:30,508 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data7/current/blk_-1986585353932177665
2013-10-31 18:46:30,508 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data8/current/blk_1166790603136202975
2013-10-31 18:46:30,508 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data7/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:30,509 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data7/current/blk_7343258894093907583
2013-10-31 18:46:31,090 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0039_m_000006_0' has completed task_20131031182606197_0039_m_000006 successfully.
2013-10-31 18:46:31,091 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0039 has completed successfully.
2013-10-31 18:46:31,092 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0039,submitTime=1383245159422,launchTime=1383245159811,firstMapTaskLaunchTime=1383245167045,firstReduceTaskLaunchTime=1383245173058,firstJobSetupTaskLaunchTime=1383245161024,firstJobCleanupTaskLaunchTime=1383245185079,finishTime=1383245191091,numMaps=6,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=37,reduceSlotsSeconds=10,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[5EE10D7CE2734FEA8E342CB39C7F3783/2C74E9795F8D496CAE6232BE71DCB34C] concat/(1/1) ...pesplatform/complexconcat
2013-10-31 18:46:31,096 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C. blk_-2645325153373715552_1402
2013-10-31 18:46:31,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:52003 dest: /127.0.0.1:34578
2013-10-31 18:46:31,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:49375 dest: /127.0.0.1:54365
2013-10-31 18:46:31,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2645325153373715552_1402 src: /127.0.0.1:45202 dest: /127.0.0.1:59471
2013-10-31 18:46:31,112 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45202, dest: /127.0.0.1:59471, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2645325153373715552_1402, duration: 3616823
2013-10-31 18:46:31,112 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,113 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49375, dest: /127.0.0.1:54365, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2645325153373715552_1402, duration: 4408852
2013-10-31 18:46:31,113 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,114 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52003, dest: /127.0.0.1:34578, bytes: 34988, op: HDFS_WRITE, cliID: DFSClient_-1631050623, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2645325153373715552_1402, duration: 5260037
2013-10-31 18:46:31,114 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,114 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2645325153373715552_1402 terminating
2013-10-31 18:46:31,120 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,121 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C from client DFSClient_-1631050623
2013-10-31 18:46:31,122 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_logs/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C is closed by DFSClient_-1631050623
2013-10-31 18:46:31,122 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2645325153373715552_1402 size 34988
2013-10-31 18:46:31,128 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0039_1383245159422_hadoop_%5B5EE10D7CE2734FEA8E342CB39C7F3783%2F2C74E9795F8D496C to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:46:31,129 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000000_0'
2013-10-31 18:46:31,129 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000001_0'
2013-10-31 18:46:31,130 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000006_0'
2013-10-31 18:46:31,131 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:46:31,131 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000007_0'
2013-10-31 18:46:31,131 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:46:31,131 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_r_000000_0'
2013-10-31 18:46:31,132 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4955026965077948598 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:46:31,134 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0039_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:46:31,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0039 dst=null perm=null
2013-10-31 18:46:31,138 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/_temporary
2013-10-31 18:46:31,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat dst=null perm=null
2013-10-31 18:46:31,157 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:46:31,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000 dst=null perm=null
2013-10-31 18:46:31,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000 dst=null perm=null
2013-10-31 18:46:31,162 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49095, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3582165743761812411_1401, duration: 2094328
2013-10-31 18:46:31,162 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/complexconcat
2013-10-31 18:46:31,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat dst=null perm=null
2013-10-31 18:46:31,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/complexconcat/part-00000 dst=null perm=null
2013-10-31 18:46:31,167 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49379, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3582165743761812411_1401, duration: 334265
2013-10-31 18:46:31,175 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:46:31,175 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:46:31,198 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting
2013-10-31 18:46:31,198 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:46:31,199 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1"]
2013-10-31 18:46:31,199 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] sink: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2"]
2013-10-31 18:46:31,199 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] parallel execution is enabled: true
2013-10-31 18:46:31,199 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] starting jobs: 3
2013-10-31 18:46:31,200 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [left+right] allocating threads: 3
2013-10-31 18:46:31,203 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (1/3)
2013-10-31 18:46:31,205 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:46:31,205 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 1
2013-10-31 18:46:31,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:31,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:46:31,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:31,227 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar. blk_1798187280963192099_1403
2013-10-31 18:46:31,229 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:49097 dest: /127.0.0.1:37740
2013-10-31 18:46:31,230 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:52010 dest: /127.0.0.1:34578
2013-10-31 18:46:31,232 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:45208 dest: /127.0.0.1:59471
2013-10-31 18:46:31,244 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45208, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 7293555
2013-10-31 18:46:31,245 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,245 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52010, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_1798187280963192099_1403, duration: 8155529
2013-10-31 18:46:31,245 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,246 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49097, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 9132833
2013-10-31 18:46:31,246 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_1798187280963192099_1403 terminating
2013-10-31 18:46:31,249 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,250 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:31,608 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_4955026965077948598_1400 blk_7343258894093907583_1397
2013-10-31 18:46:31,608 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5434570261073731497_1396 blk_1166790603136202975_1395 blk_-1986585353932177665_1394 blk_4955026965077948598_1400
2013-10-31 18:46:31,649 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar from client DFSClient_-1596270109
2013-10-31 18:46:31,649 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:46:31,881 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000002_0'
2013-10-31 18:46:31,881 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000003_0'
2013-10-31 18:46:31,884 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000004_0'
2013-10-31 18:46:31,885 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0039_m_000005_0'
2013-10-31 18:46:31,968 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:31,968 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0039 being deleted.
2013-10-31 18:46:32,310 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data3/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:32,310 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data3/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:32,310 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data4/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:32,310 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data3/current/blk_-1986585353932177665
2013-10-31 18:46:32,311 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data4/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:32,311 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data3/current/blk_1166790603136202975
2013-10-31 18:46:32,311 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data4/current/blk_4955026965077948598
2013-10-31 18:46:32,312 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data4/current/blk_5434570261073731497
2013-10-31 18:46:33,039 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-1986585353932177665_1394 file build/test/data/dfs/data/data6/current/blk_-1986585353932177665 for deletion
2013-10-31 18:46:33,039 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1166790603136202975_1395 file build/test/data/dfs/data/data5/current/blk_1166790603136202975 for deletion
2013-10-31 18:46:33,039 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-1986585353932177665_1394 at file build/test/data/dfs/data/data6/current/blk_-1986585353932177665
2013-10-31 18:46:33,039 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data5/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:33,039 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1166790603136202975_1395 at file build/test/data/dfs/data/data5/current/blk_1166790603136202975
2013-10-31 18:46:33,040 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5434570261073731497_1396 file build/test/data/dfs/data/data6/current/blk_5434570261073731497 for deletion
2013-10-31 18:46:33,040 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data5/current/blk_4955026965077948598
2013-10-31 18:46:33,040 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5434570261073731497_1396 at file build/test/data/dfs/data/data6/current/blk_5434570261073731497
2013-10-31 18:46:33,040 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7343258894093907583_1397 file build/test/data/dfs/data/data5/current/blk_7343258894093907583 for deletion
2013-10-31 18:46:33,041 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7343258894093907583_1397 at file build/test/data/dfs/data/data5/current/blk_7343258894093907583
2013-10-31 18:46:33,182 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar. New replication is 10
2013-10-31 18:46:33,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=null
2013-10-31 18:46:33,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,195 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:46:33,199 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:46:33,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:46:33,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,215 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split. New replication is 10
2013-10-31 18:46:33,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=null
2013-10-31 18:46:33,224 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split. blk_7967776557441908343_1404
2013-10-31 18:46:33,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:45209 dest: /127.0.0.1:59471
2013-10-31 18:46:33,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:52013 dest: /127.0.0.1:34578
2013-10-31 18:46:33,229 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:49102 dest: /127.0.0.1:37740
2013-10-31 18:46:33,230 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7967776557441908343_1404 src: /127.0.0.1:49386 dest: /127.0.0.1:54365
2013-10-31 18:46:33,234 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49386, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 646124
2013-10-31 18:46:33,235 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,235 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49102, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7967776557441908343_1404, duration: 1498478
2013-10-31 18:46:33,236 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,236 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,237 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,237 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52013, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7967776557441908343_1404, duration: 3036045
2013-10-31 18:46:33,237 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,237 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,237 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45209, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7967776557441908343_1404, duration: 3828460
2013-10-31 18:46:33,238 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_7967776557441908343_1404 terminating
2013-10-31 18:46:33,240 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7967776557441908343_1404 size 1403
2013-10-31 18:46:33,241 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split from client DFSClient_-1596270109
2013-10-31 18:46:33,241 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split is closed by DFSClient_-1596270109
2013-10-31 18:46:33,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,258 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo. blk_4924507397654323874_1405
2013-10-31 18:46:33,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:45213 dest: /127.0.0.1:59471
2013-10-31 18:46:33,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:49105 dest: /127.0.0.1:37740
2013-10-31 18:46:33,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4924507397654323874_1405 src: /127.0.0.1:52018 dest: /127.0.0.1:34578
2013-10-31 18:46:33,264 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52018, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4924507397654323874_1405, duration: 70530
2013-10-31 18:46:33,264 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,264 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,265 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49105, dest: /127.0.0.1:37740, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4924507397654323874_1405, duration: 955464
2013-10-31 18:46:33,265 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,266 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45213, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4924507397654323874_1405, duration: 1498172
2013-10-31 18:46:33,266 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4924507397654323874_1405 terminating
2013-10-31 18:46:33,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,269 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:46:33,269 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:46:33,269 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4924507397654323874_1405 size 156
2013-10-31 18:46:33,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,294 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml. blk_7803140496788561719_1406
2013-10-31 18:46:33,295 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:45216 dest: /127.0.0.1:59471
2013-10-31 18:46:33,296 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:52020 dest: /127.0.0.1:34578
2013-10-31 18:46:33,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7803140496788561719_1406 src: /127.0.0.1:49109 dest: /127.0.0.1:37740
2013-10-31 18:46:33,300 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49109, dest: /127.0.0.1:37740, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7803140496788561719_1406, duration: 323391
2013-10-31 18:46:33,301 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,301 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52020, dest: /127.0.0.1:34578, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7803140496788561719_1406, duration: 1130500
2013-10-31 18:46:33,302 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,302 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,302 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45216, dest: /127.0.0.1:59471, bytes: 28448, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 2014567
2013-10-31 18:46:33,303 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7803140496788561719_1406 terminating
2013-10-31 18:46:33,305 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,306 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml from client DFSClient_-1596270109
2013-10-31 18:46:33,306 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:46:33,306 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7803140496788561719_1406 size 28448
2013-10-31 18:46:33,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=null
2013-10-31 18:46:33,323 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45220, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 454838
2013-10-31 18:46:33,338 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0040: nMaps=4 nReduces=1 max=-1
2013-10-31 18:46:33,338 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0040 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:46:33,339 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0040 RESULT=SUCCESS
2013-10-31 18:46:33,339 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0040
2013-10-31 18:46:33,339 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0040
2013-10-31 18:46:33,339 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0040
2013-10-31 18:46:33,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,373 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml. blk_-8600798403005839553_1408
2013-10-31 18:46:33,375 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:52026 dest: /127.0.0.1:34578
2013-10-31 18:46:33,377 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:45224 dest: /127.0.0.1:59471
2013-10-31 18:46:33,378 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8600798403005839553_1408 src: /127.0.0.1:49399 dest: /127.0.0.1:54365
2013-10-31 18:46:33,383 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49399, dest: /127.0.0.1:54365, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8600798403005839553_1408, duration: 1012256
2013-10-31 18:46:33,384 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,384 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45224, dest: /127.0.0.1:59471, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8600798403005839553_1408, duration: 1899607
2013-10-31 18:46:33,385 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,385 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,385 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52026, dest: /127.0.0.1:34578, bytes: 28513, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8600798403005839553_1408, duration: 3574241
2013-10-31 18:46:33,386 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8600798403005839553_1408 terminating
2013-10-31 18:46:33,388 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,389 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml from client DFSClient_-1340262821
2013-10-31 18:46:33,389 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_conf.xml is closed by DFSClient_-1340262821
2013-10-31 18:46:33,390 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8600798403005839553_1408 size 28513
2013-10-31 18:46:33,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:33,406 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken. blk_-6312158700066968443_1409
2013-10-31 18:46:33,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:52029 dest: /127.0.0.1:34578
2013-10-31 18:46:33,409 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:45227 dest: /127.0.0.1:59471
2013-10-31 18:46:33,411 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6312158700066968443_1409 src: /127.0.0.1:49402 dest: /127.0.0.1:54365
2013-10-31 18:46:33,413 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49402, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 658090
2013-10-31 18:46:33,414 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,414 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45227, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6312158700066968443_1409, duration: 878029
2013-10-31 18:46:33,415 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,415 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52029, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 1867257
2013-10-31 18:46:33,416 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6312158700066968443_1409 terminating
2013-10-31 18:46:33,416 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,418 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken from client DFSClient_-1596270109
2013-10-31 18:46:33,419 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:46:33,419 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,420 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6312158700066968443_1409 size 116
2013-10-31 18:46:33,690 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken
2013-10-31 18:46:33,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.splitmetainfo dst=null perm=null
2013-10-31 18:46:33,707 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45230, bytes: 160, op: HDFS_READ, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_4924507397654323874_1405, duration: 12666889
2013-10-31 18:46:33,708 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0040 = 1449. Number of splits = 4
2013-10-31 18:46:33,708 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,711 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,713 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,714 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0040_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:46:33,715 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0040 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:46:33,716 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0040 initialized successfully with 4 map tasks and 1 reduce tasks.
2013-10-31 18:46:34,138 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0040_m_000005_0' to tip task_20131031182606197_0040_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:34,149 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:46:34,149 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000005_0 which needs 1 slots
2013-10-31 18:46:34,149 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000005_0 which needs 1 slots
2013-10-31 18:46:34,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken dst=null perm=null
2013-10-31 18:46:34,158 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52034, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 293176
2013-10-31 18:46:34,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=null
2013-10-31 18:46:34,168 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45233, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1810385824, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 395471
2013-10-31 18:46:34,198 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:34,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=null
2013-10-31 18:46:34,228 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45234, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1810385824, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 1165799
2013-10-31 18:46:34,324 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:34,331 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group7992 with signal TERM. Exit code 0
2013-10-31 18:46:34,331 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-976513709
2013-10-31 18:46:34,332 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-976513709 spawned.
2013-10-31 18:46:34,333 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000005_0/taskjvm.sh
2013-10-31 18:46:34,609 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_1798187280963192099_1403 to datanode(s) 127.0.0.1:54365
2013-10-31 18:46:34,610 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_4955026965077948598_1400
2013-10-31 18:46:34,760 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0039_m_902584542
2013-10-31 18:46:35,064 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:35,064 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:35,064 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:35,064 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_902584542 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:46:35,712 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-976513709 given task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:36,132 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,133 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0039_m_000006_0 not found in cache
2013-10-31 18:46:36,133 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596133
2013-10-31 18:46:36,176 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_r_593026137 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:36,181 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8511 with signal TERM. Exit code 0
2013-10-31 18:46:36,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:36,341 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:36,341 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:36,341 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:36,342 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_r_593026137 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:36,437 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_1798187280963192099_1403 to 127.0.0.1:54365
2013-10-31 18:46:36,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_1798187280963192099_1403 src: /127.0.0.1:49411 dest: /127.0.0.1:54365
2013-10-31 18:46:36,439 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_1798187280963192099_1403 to /127.0.0.1:54365
2013-10-31 18:46:36,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_1798187280963192099_1403 src: /127.0.0.1:49411 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:46:36,446 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_1798187280963192099_1403 size 238055
2013-10-31 18:46:36,510 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4955026965077948598_1400 file build/test/data/dfs/data/data8/current/blk_4955026965077948598 for deletion
2013-10-31 18:46:36,510 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4955026965077948598_1400 at file build/test/data/dfs/data/data8/current/blk_4955026965077948598
2013-10-31 18:46:36,882 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,883 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596883
2013-10-31 18:46:36,885 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0039
2013-10-31 18:46:36,886 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0039 for user-log deletion with retainTimeStamp:1383331596886
2013-10-31 18:46:37,274 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_1010047912 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,284 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8122 with signal TERM. Exit code 0
2013-10-31 18:46:37,463 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,463 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,463 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:37,463 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_1010047912 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:46:37,629 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-1608983854 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,633 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-387027469 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,641 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8245 with signal TERM. Exit code 0
2013-10-31 18:46:37,644 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8246 with signal TERM. Exit code 0
2013-10-31 18:46:37,816 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_1519844982 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,816 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0039_m_-204099648 since job job_20131031182606197_0039 is dead
2013-10-31 18:46:37,823 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8240 with signal TERM. Exit code 0
2013-10-31 18:46:37,823 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8248 with signal TERM. Exit code 0
2013-10-31 18:46:37,875 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,875 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,875 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:37,875 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-1608983854 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:37,878 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:37,878 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:37,878 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:37,878 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-387027469 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:38,003 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:38,004 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:38,004 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:38,004 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_1519844982 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:38,016 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:46:38,016 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:46:38,016 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:46:38,016 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0039_m_-204099648 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:46:39,126 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000005_0 0.0% setup
2013-10-31 18:46:39,129 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000005_0 is done.
2013-10-31 18:46:39,129 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000005_0 was -1
2013-10-31 18:46:39,130 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:40,156 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000005_0' has completed task_20131031182606197_0040_m_000005 successfully.
2013-10-31 18:46:40,161 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000000_0' to tip task_20131031182606197_0040_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:40,164 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000000
2013-10-31 18:46:40,166 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:40,166 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000000_0 which needs 1 slots
2013-10-31 18:46:40,167 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000000_0 which needs 1 slots
2013-10-31 18:46:40,201 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_1560840909
2013-10-31 18:46:40,201 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_1560840909 spawned.
2013-10-31 18:46:40,204 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000000_0/taskjvm.sh
2013-10-31 18:46:40,889 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000001_0' to tip task_20131031182606197_0040_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:46:40,890 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000001
2013-10-31 18:46:40,891 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:46:40,891 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000001_0 which needs 1 slots
2013-10-31 18:46:40,892 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000001_0 which needs 1 slots
2013-10-31 18:46:40,896 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000002_0' to tip task_20131031182606197_0040_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:46:40,897 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000002
2013-10-31 18:46:40,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken dst=null perm=null
2013-10-31 18:46:40,898 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:46:40,899 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000002_0 which needs 1 slots
2013-10-31 18:46:40,899 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000002_0 which needs 1 slots
2013-10-31 18:46:40,902 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49413, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 282801
2013-10-31 18:46:40,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken dst=null perm=null
2013-10-31 18:46:40,905 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49414, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6312158700066968443_1409, duration: 303807
2013-10-31 18:46:40,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=null
2013-10-31 18:46:40,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=null
2013-10-31 18:46:40,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45244, bytes: 28672, op: HDFS_READ, cliID: DFSClient_89036823, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 185293
2013-10-31 18:46:40,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52046, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-73294791, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7803140496788561719_1406, duration: 396056
2013-10-31 18:46:40,932 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:40,938 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:40,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=null
2013-10-31 18:46:40,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49136, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-73294791, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 691612
2013-10-31 18:46:40,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=null
2013-10-31 18:46:40,952 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49137, bytes: 239915, op: HDFS_READ, cliID: DFSClient_89036823, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_1798187280963192099_1403, duration: 640276
2013-10-31 18:46:40,975 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0040_m_000003_0' to tip task_20131031182606197_0040_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:46:40,975 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0040_m_000003
2013-10-31 18:46:40,976 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:46:40,976 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000003_0 which needs 1 slots
2013-10-31 18:46:40,976 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000003_0 which needs 1 slots
2013-10-31 18:46:40,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040/jobToken dst=null perm=null
2013-10-31 18:46:40,980 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52050, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6312158700066968443_1409, duration: 131404
2013-10-31 18:46:40,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.xml dst=null perm=null
2013-10-31 18:46:40,985 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45249, bytes: 28672, op: HDFS_READ, cliID: DFSClient_-1896772921, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_7803140496788561719_1406, duration: 155227
2013-10-31 18:46:40,998 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:46:41,011 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_85603554
2013-10-31 18:46:41,012 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_85603554 spawned.
2013-10-31 18:46:41,015 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-512244477
2013-10-31 18:46:41,015 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000002_0/taskjvm.sh
2013-10-31 18:46:41,015 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-512244477 spawned.
2013-10-31 18:46:41,016 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000001_0/taskjvm.sh
2013-10-31 18:46:41,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.jar dst=null perm=null
2013-10-31 18:46:41,021 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45250, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1896772921, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_1798187280963192099_1403, duration: 681117
2013-10-31 18:46:41,040 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_1560840909 given task: attempt_20131031182606197_0040_m_000000_0
2013-10-31 18:46:42,291 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_m_-1744508755
2013-10-31 18:46:42,293 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_m_-1744508755 spawned.
2013-10-31 18:46:42,295 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_m_000003_0/taskjvm.sh
2013-10-31 18:46:43,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=null
2013-10-31 18:46:43,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49143, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7967776557441908343_1404, duration: 176507
2013-10-31 18:46:43,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:46:43,163 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49144, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 111164
2013-10-31 18:46:43,525 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_85603554 given task: attempt_20131031182606197_0040_m_000002_0
2013-10-31 18:46:43,652 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-1744508755 given task: attempt_20131031182606197_0040_m_000003_0
2013-10-31 18:46:43,656 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_-512244477 given task: attempt_20131031182606197_0040_m_000001_0
2013-10-31 18:46:44,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=null
2013-10-31 18:46:44,023 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49432, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 225184
2013-10-31 18:46:44,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:46:44,066 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49433, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_695637524992237905_1002, duration: 166029
2013-10-31 18:46:44,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=null
2013-10-31 18:46:44,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49436, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7967776557441908343_1404, duration: 169329
2013-10-31 18:46:44,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040/job.split dst=null perm=null
2013-10-31 18:46:44,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52066, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000003_0, offset: 1024, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7967776557441908343_1404, duration: 106172
2013-10-31 18:46:44,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:46:44,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:46:44,201 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52067, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 183655
2013-10-31 18:46:44,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52068, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0040_m_000001_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 176290
2013-10-31 18:46:45,166 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:45,167 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0040_m_000005_0
2013-10-31 18:46:45,167 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0040_m_000005_0 not found in cache
2013-10-31 18:46:46,042 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:46:46,045 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000000_0 is done.
2013-10-31 18:46:46,045 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000000_0 was 54
2013-10-31 18:46:46,045 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:46,171 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000000_0' has completed task_20131031182606197_0040_m_000000 successfully.
2013-10-31 18:46:46,173 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (REDUCE) 'attempt_20131031182606197_0040_r_000000_0' to tip task_20131031182606197_0040_r_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:46:46,175 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_r_000000_0 task's state:UNASSIGNED
2013-10-31 18:46:46,176 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_r_000000_0 which needs 1 slots
2013-10-31 18:46:46,176 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_r_000000_0 which needs 1 slots
2013-10-31 18:46:46,205 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0040_r_-378893990
2013-10-31 18:46:46,206 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0040_r_-378893990 spawned.
2013-10-31 18:46:46,207 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0040/attempt_20131031182606197_0040_r_000000_0/taskjvm.sh
2013-10-31 18:46:46,948 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:46:46,950 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000002_0 is done.
2013-10-31 18:46:46,950 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000002_0 was 73
2013-10-31 18:46:46,950 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,079 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:46:47,081 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000001_0 is done.
2013-10-31 18:46:47,081 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000001_0 was 74
2013-10-31 18:46:47,081 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,088 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:46:47,090 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000003_0 is done.
2013-10-31 18:46:47,090 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000003_0 was 53
2013-10-31 18:46:47,090 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:46:47,365 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_r_-378893990 given task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:49,899 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000001_0' has completed task_20131031182606197_0040_m_000001 successfully.
2013-10-31 18:46:49,904 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000002_0' has completed task_20131031182606197_0040_m_000002 successfully.
2013-10-31 18:46:49,984 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000003_0' has completed task_20131031182606197_0040_m_000003 successfully.
2013-10-31 18:46:52,009 INFO metrics.MetricsSaver (?:compactRawValues(?)) - aggregated JobSubmissionProtocol.getJobStatus 51 raw values into 1 aggregated values, total 55
2013-10-31 18:46:53,025 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:59831, dest: 10.5.128.102:43474, bytes: 54, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000000_0, duration: 9004353
2013-10-31 18:46:53,832 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:46:55,184 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 1 OK for attempt_20131031182606197_0040_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:46:55,513 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_6508054468461277982_1338
2013-10-31 18:46:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:46:56,019 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,024 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,029 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,040 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,045 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:46:56,045 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:46:56,880 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:46:58,059 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:54694, dest: 10.5.128.102:41455, bytes: 74, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000001_0, duration: 13354663
2013-10-31 18:46:58,079 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:44527, dest: 10.5.128.102:46153, bytes: 73, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000002_0, duration: 13398616
2013-10-31 18:46:58,096 INFO TaskTracker.clienttrace (TaskTracker.java:doGet(4079)) - src: 10.5.128.102:41705, dest: 10.5.128.102:51112, bytes: 53, op: MAPRED_SHUFFLE, cliID: attempt_20131031182606197_0040_m_000003_0, duration: 12199776
2013-10-31 18:46:58,891 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:46:58,950 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:46:59,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:46:59,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:46:59,183 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000. blk_3095433216454494385_1410
2013-10-31 18:46:59,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:49166 dest: /127.0.0.1:37740
2013-10-31 18:46:59,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:49450 dest: /127.0.0.1:54365
2013-10-31 18:46:59,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3095433216454494385_1410 src: /127.0.0.1:52080 dest: /127.0.0.1:34578
2013-10-31 18:46:59,231 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52080, dest: /127.0.0.1:34578, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3095433216454494385_1410, duration: 1386162
2013-10-31 18:46:59,233 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,233 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49450, dest: /127.0.0.1:54365, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3095433216454494385_1410, duration: 4300544
2013-10-31 18:46:59,234 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,234 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49166, dest: /127.0.0.1:37740, bytes: 131, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0040_r_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3095433216454494385_1410, duration: 5049614
2013-10-31 18:46:59,235 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3095433216454494385_1410 terminating
2013-10-31 18:46:59,235 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3095433216454494385_1410 size 131
2013-10-31 18:46:59,239 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:59,239 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:46:59,276 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0040_r_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:46:59,277 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 0.083333336% reduce > copy (1 of 4 at 0.00 MB/s) >
2013-10-31 18:47:01,193 INFO mapred.JobTracker (JobTracker.java:logFetchStatus(4805)) - FetchStatus 3 OK for attempt_20131031182606197_0040_r_000000_0 from tracker_10.5.128.102:localhost/127.0.0.1:48953
2013-10-31 18:47:01,194 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:01,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0 dst=null perm=null
2013-10-31 18:47:01,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:01,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0/part-00000 dst=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:01,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary/_attempt_20131031182606197_0040_r_000000_0 dst=null perm=null
2013-10-31 18:47:02,935 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 1.0% reduce > reduce
2013-10-31 18:47:02,937 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_r_000000_0 1.0% reduce > reduce
2013-10-31 18:47:02,938 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_r_000000_0 is done.
2013-10-31 18:47:02,939 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_r_000000_0 was -1
2013-10-31 18:47:02,939 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:04,198 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_r_000000_0' has completed task_20131031182606197_0040_r_000000 successfully.
2013-10-31 18:47:04,201 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0040_m_000004_0' to tip task_20131031182606197_0040_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:04,203 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0040_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:47:04,204 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0040_m_000004_0 which needs 1 slots
2013-10-31 18:47:04,204 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0040_m_000004_0 which needs 1 slots
2013-10-31 18:47:04,240 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0040/attempt_20131031182606197_0040_m_000004_0. Attempting to reuse: jvm_20131031182606197_0040_m_1560840909
2013-10-31 18:47:04,615 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0040_m_1560840909 given task: attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,766 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000004_0 0.0%
2013-10-31 18:47:04,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_temporary dst=null perm=null
2013-10-31 18:47:04,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:04,795 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS from client DFSClient_attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,796 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0040_m_000004_0
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_1798187280963192099 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,805 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7967776557441908343 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_4924507397654323874 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:04,806 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7803140496788561719 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:04,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0040 dst=null perm=null
2013-10-31 18:47:07,615 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_7967776557441908343_1404
2013-10-31 18:47:07,615 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_7967776557441908343_1404
2013-10-31 18:47:07,711 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0040_m_000004_0 0.0% cleanup
2013-10-31 18:47:07,712 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0040_m_000004_0 is done.
2013-10-31 18:47:07,713 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0040_m_000004_0 was -1
2013-10-31 18:47:07,713 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:09,051 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data6/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:09,051 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data6/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:09,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data5/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:09,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data6/current/blk_1798187280963192099
2013-10-31 18:47:09,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data5/current/blk_7803140496788561719
2013-10-31 18:47:09,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data6/current/blk_4924507397654323874
2013-10-31 18:47:09,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data5/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:09,053 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data5/current/blk_7967776557441908343
2013-10-31 18:47:09,204 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:09,204 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0040_r_000000_0
2013-10-31 18:47:09,520 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data8/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data8/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data7/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data8/current/blk_1798187280963192099
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data7/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data8/current/blk_4924507397654323874
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data7/current/blk_7803140496788561719
2013-10-31 18:47:09,521 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data7/current/blk_7967776557441908343
2013-10-31 18:47:10,211 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0040_m_000004_0' has completed task_20131031182606197_0040_m_000004 successfully.
2013-10-31 18:47:10,212 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0040 has completed successfully.
2013-10-31 18:47:10,213 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0040,submitTime=1383245193313,launchTime=1383245193715,firstMapTaskLaunchTime=1383245200161,firstReduceTaskLaunchTime=1383245206173,firstJobSetupTaskLaunchTime=1383245194138,firstJobCleanupTaskLaunchTime=1383245224200,finishTime=1383245230212,numMaps=4,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=31,reduceSlotsSeconds=16,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/896A269D29444F36B2F51092499887F5] left+right/(1/3)
2013-10-31 18:47:10,217 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36. blk_-8506542354890884660_1411
2013-10-31 18:47:10,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:45280 dest: /127.0.0.1:59471
2013-10-31 18:47:10,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:52084 dest: /127.0.0.1:34578
2013-10-31 18:47:10,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8506542354890884660_1411 src: /127.0.0.1:49456 dest: /127.0.0.1:54365
2013-10-31 18:47:10,236 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49456, dest: /127.0.0.1:54365, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8506542354890884660_1411, duration: 8671695
2013-10-31 18:47:10,236 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,237 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52084, dest: /127.0.0.1:34578, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8506542354890884660_1411, duration: 8491880
2013-10-31 18:47:10,237 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,238 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45280, dest: /127.0.0.1:59471, bytes: 28278, op: HDFS_WRITE, cliID: DFSClient_-1340262821, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8506542354890884660_1411, duration: 10549411
2013-10-31 18:47:10,238 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8506542354890884660_1411 terminating
2013-10-31 18:47:10,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,241 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 from client DFSClient_-1340262821
2013-10-31 18:47:10,241 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/_logs/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 is closed by DFSClient_-1340262821
2013-10-31 18:47:10,241 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,242 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8506542354890884660_1411 size 28278
2013-10-31 18:47:10,247 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0040_1383245193313_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F896A269D29444F36 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:10,248 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000000_0'
2013-10-31 18:47:10,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000004_0'
2013-10-31 18:47:10,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:10,249 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:10,250 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-6312158700066968443 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:10,249 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000005_0'
2013-10-31 18:47:10,250 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0040_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:10,250 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_r_000000_0'
2013-10-31 18:47:10,253 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (2/3) ...dpipesplatform/splitcomp2
2013-10-31 18:47:10,253 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] starting step: (3/3) ...dpipesplatform/splitcomp1
2013-10-31 18:47:10,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0040 dst=null perm=null
2013-10-31 18:47:10,257 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:10,257 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:10,258 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:10,258 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:10,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:10,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:47:10,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:10,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:47:10,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,284 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar. blk_-2565091071161671132_1412
2013-10-31 18:47:10,285 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:52087 dest: /127.0.0.1:34578
2013-10-31 18:47:10,288 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:49176 dest: /127.0.0.1:37740
2013-10-31 18:47:10,289 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:45286 dest: /127.0.0.1:59471
2013-10-31 18:47:10,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,293 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar. blk_3570503195496497577_1413
2013-10-31 18:47:10,294 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45286, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2565091071161671132_1412, duration: 1558803
2013-10-31 18:47:10,294 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:45287 dest: /127.0.0.1:59471
2013-10-31 18:47:10,294 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,295 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49176, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2565091071161671132_1412, duration: 2571086
2013-10-31 18:47:10,295 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:52091 dest: /127.0.0.1:34578
2013-10-31 18:47:10,295 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,296 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52087, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2565091071161671132_1412, duration: 3618267
2013-10-31 18:47:10,296 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2565091071161671132_1412 terminating
2013-10-31 18:47:10,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:49180 dest: /127.0.0.1:37740
2013-10-31 18:47:10,307 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,307 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:10,307 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:10,307 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,307 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:10,316 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar. New replication is 10
2013-10-31 18:47:10,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar dst=null perm=null
2013-10-31 18:47:10,332 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49180, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3570503195496497577_1413, duration: 17535199
2013-10-31 18:47:10,333 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,333 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,333 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52091, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3570503195496497577_1413, duration: 17422729
2013-10-31 18:47:10,333 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,334 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45287, dest: /127.0.0.1:59471, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3570503195496497577_1413, duration: 20509370
2013-10-31 18:47:10,334 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,336 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3570503195496497577_1413 terminating
2013-10-31 18:47:10,336 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:10,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:10,339 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:10,339 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:10,339 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:10,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1 dst=null perm=null
2013-10-31 18:47:10,382 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:10,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000 dst=null perm=null
2013-10-31 18:47:10,616 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:59471 to replicate blk_-2565091071161671132_1412 to datanode(s) 127.0.0.1:54365
2013-10-31 18:47:10,616 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_1798187280963192099_1403 blk_4924507397654323874_1405 blk_7803140496788561719_1406 blk_-6312158700066968443_1409 blk_7967776557441908343_1404
2013-10-31 18:47:10,616 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_1798187280963192099_1403 blk_-6312158700066968443_1409 blk_7967776557441908343_1404
2013-10-31 18:47:10,924 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000001_0'
2013-10-31 18:47:10,928 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000002_0'
2013-10-31 18:47:11,005 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0040_m_000003_0'
2013-10-31 18:47:11,059 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar. New replication is 10
2013-10-31 18:47:11,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar dst=null perm=null
2013-10-31 18:47:11,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,082 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split. New replication is 10
2013-10-31 18:47:11,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,086 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:11,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1 dst=null perm=null
2013-10-31 18:47:11,091 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:11,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000 dst=null perm=null
2013-10-31 18:47:11,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split dst=null perm=null
2013-10-31 18:47:11,095 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split. blk_3499764083074527036_1415
2013-10-31 18:47:11,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:49464 dest: /127.0.0.1:54365
2013-10-31 18:47:11,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:45291 dest: /127.0.0.1:59471
2013-10-31 18:47:11,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:49183 dest: /127.0.0.1:37740
2013-10-31 18:47:11,102 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3499764083074527036_1415 src: /127.0.0.1:52096 dest: /127.0.0.1:34578
2013-10-31 18:47:11,108 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52096, dest: /127.0.0.1:34578, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3499764083074527036_1415, duration: 73222
2013-10-31 18:47:11,108 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,108 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,108 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49183, dest: /127.0.0.1:37740, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_3499764083074527036_1415, duration: 2919134
2013-10-31 18:47:11,109 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,109 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45291, dest: /127.0.0.1:59471, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3499764083074527036_1415, duration: 3866508
2013-10-31 18:47:11,110 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,110 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,110 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49464, dest: /127.0.0.1:54365, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3499764083074527036_1415, duration: 4756833
2013-10-31 18:47:11,111 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_3499764083074527036_1415 terminating
2013-10-31 18:47:11,116 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,116 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split from client DFSClient_-1596270109
2013-10-31 18:47:11,117 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:11,117 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3499764083074527036_1415 size 352
2013-10-31 18:47:11,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,128 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split. New replication is 10
2013-10-31 18:47:11,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split dst=null perm=null
2013-10-31 18:47:11,140 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split. blk_-5014300393221569912_1416
2013-10-31 18:47:11,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:45294 dest: /127.0.0.1:59471
2013-10-31 18:47:11,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:52098 dest: /127.0.0.1:34578
2013-10-31 18:47:11,145 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:49187 dest: /127.0.0.1:37740
2013-10-31 18:47:11,146 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-5014300393221569912_1416 src: /127.0.0.1:49471 dest: /127.0.0.1:54365
2013-10-31 18:47:11,152 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49471, dest: /127.0.0.1:54365, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-5014300393221569912_1416, duration: 1920060
2013-10-31 18:47:11,152 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,153 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,153 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49187, dest: /127.0.0.1:37740, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-5014300393221569912_1416, duration: 3676750
2013-10-31 18:47:11,153 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,154 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52098, dest: /127.0.0.1:34578, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5014300393221569912_1416, duration: 4486445
2013-10-31 18:47:11,154 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,154 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,155 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45294, dest: /127.0.0.1:59471, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-5014300393221569912_1416, duration: 5480929
2013-10-31 18:47:11,156 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,156 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-5014300393221569912_1416 terminating
2013-10-31 18:47:11,159 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-5014300393221569912_1416 size 352
2013-10-31 18:47:11,159 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split from client DFSClient_-1596270109
2013-10-31 18:47:11,159 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:11,160 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo. blk_2605274129487483737_1416
2013-10-31 18:47:11,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:52101 dest: /127.0.0.1:34578
2013-10-31 18:47:11,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:49190 dest: /127.0.0.1:37740
2013-10-31 18:47:11,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2605274129487483737_1416 src: /127.0.0.1:45300 dest: /127.0.0.1:59471
2013-10-31 18:47:11,168 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45300, dest: /127.0.0.1:59471, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2605274129487483737_1416, duration: 544183
2013-10-31 18:47:11,169 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,169 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49190, dest: /127.0.0.1:37740, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2605274129487483737_1416, duration: 1321596
2013-10-31 18:47:11,169 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,170 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52101, dest: /127.0.0.1:34578, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2605274129487483737_1416, duration: 2171893
2013-10-31 18:47:11,170 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2605274129487483737_1416 terminating
2013-10-31 18:47:11,174 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,174 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:11,175 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:11,175 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,176 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2605274129487483737_1416 size 44
2013-10-31 18:47:11,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,192 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo. blk_5953021751685955983_1418
2013-10-31 18:47:11,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,194 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:52104 dest: /127.0.0.1:34578
2013-10-31 18:47:11,195 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:45302 dest: /127.0.0.1:59471
2013-10-31 18:47:11,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5953021751685955983_1418 src: /127.0.0.1:49477 dest: /127.0.0.1:54365
2013-10-31 18:47:11,200 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49477, dest: /127.0.0.1:54365, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5953021751685955983_1418, duration: 68724
2013-10-31 18:47:11,200 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,200 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45302, dest: /127.0.0.1:59471, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5953021751685955983_1418, duration: 858081
2013-10-31 18:47:11,201 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,201 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52104, dest: /127.0.0.1:34578, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5953021751685955983_1418, duration: 1733917
2013-10-31 18:47:11,201 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,202 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5953021751685955983_1418 terminating
2013-10-31 18:47:11,204 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:11,205 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:11,205 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,206 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5953021751685955983_1418 size 44
2013-10-31 18:47:11,211 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml. blk_-8036325246898089699_1418
2013-10-31 18:47:11,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:52107 dest: /127.0.0.1:34578
2013-10-31 18:47:11,214 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:49196 dest: /127.0.0.1:37740
2013-10-31 18:47:11,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8036325246898089699_1418 src: /127.0.0.1:45306 dest: /127.0.0.1:59471
2013-10-31 18:47:11,219 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45306, dest: /127.0.0.1:59471, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8036325246898089699_1418, duration: 654776
2013-10-31 18:47:11,220 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,220 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49196, dest: /127.0.0.1:37740, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8036325246898089699_1418, duration: 1439103
2013-10-31 18:47:11,221 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,221 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52107, dest: /127.0.0.1:34578, bytes: 28098, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 2329956
2013-10-31 18:47:11,221 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8036325246898089699_1418 terminating
2013-10-31 18:47:11,223 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,223 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,224 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:11,238 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:11,238 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8036325246898089699_1418 size 28098
2013-10-31 18:47:11,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data4/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:11,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data3/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:11,323 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data4/current/blk_-6312158700066968443
2013-10-31 18:47:11,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data4/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:11,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data3/current/blk_1798187280963192099
2013-10-31 18:47:11,324 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data4/current/blk_7967776557441908343
2013-10-31 18:47:11,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml dst=null perm=null
2013-10-31 18:47:11,526 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52111, bytes: 28318, op: HDFS_READ, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 410423
2013-10-31 18:47:11,545 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0041: nMaps=1 nReduces=0 max=-1
2013-10-31 18:47:11,545 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0041 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:11,545 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0041
2013-10-31 18:47:11,545 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0041 RESULT=SUCCESS
2013-10-31 18:47:11,546 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0041
2013-10-31 18:47:11,547 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0041
2013-10-31 18:47:11,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,562 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml. blk_-812474416209307718_1420
2013-10-31 18:47:11,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:49483 dest: /127.0.0.1:54365
2013-10-31 18:47:11,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:49201 dest: /127.0.0.1:37740
2013-10-31 18:47:11,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-812474416209307718_1420 src: /127.0.0.1:52114 dest: /127.0.0.1:34578
2013-10-31 18:47:11,570 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52114, dest: /127.0.0.1:34578, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-812474416209307718_1420, duration: 71960
2013-10-31 18:47:11,570 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,570 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,571 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49201, dest: /127.0.0.1:37740, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-812474416209307718_1420, duration: 1039926
2013-10-31 18:47:11,571 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,572 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,572 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49483, dest: /127.0.0.1:54365, bytes: 28102, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-812474416209307718_1420, duration: 2147999
2013-10-31 18:47:11,573 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-812474416209307718_1420 terminating
2013-10-31 18:47:11,575 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:11,575 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:11,576 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-812474416209307718_1420 size 28102
2013-10-31 18:47:11,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,584 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml. blk_2769756318727575082_1421
2013-10-31 18:47:11,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:45312 dest: /127.0.0.1:59471
2013-10-31 18:47:11,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:52117 dest: /127.0.0.1:34578
2013-10-31 18:47:11,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_2769756318727575082_1421 src: /127.0.0.1:49206 dest: /127.0.0.1:37740
2013-10-31 18:47:11,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml dst=null perm=null
2013-10-31 18:47:11,594 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49206, dest: /127.0.0.1:37740, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_2769756318727575082_1421, duration: 584798
2013-10-31 18:47:11,595 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,595 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,596 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52117, dest: /127.0.0.1:34578, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2769756318727575082_1421, duration: 1816574
2013-10-31 18:47:11,596 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,596 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49490, bytes: 28322, op: HDFS_READ, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-812474416209307718_1420, duration: 396625
2013-10-31 18:47:11,597 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45312, dest: /127.0.0.1:59471, bytes: 28163, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_2769756318727575082_1421, duration: 2715086
2013-10-31 18:47:11,597 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,597 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_2769756318727575082_1421 terminating
2013-10-31 18:47:11,602 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_2769756318727575082_1421 size 28163
2013-10-31 18:47:11,603 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml from client DFSClient_747896772
2013-10-31 18:47:11,603 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_conf.xml is closed by DFSClient_747896772
2013-10-31 18:47:11,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,619 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken. blk_7668973597655018822_1422
2013-10-31 18:47:11,620 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0042: nMaps=1 nReduces=0 max=-1
2013-10-31 18:47:11,620 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0042 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:11,620 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0042
2013-10-31 18:47:11,620 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0042 RESULT=SUCCESS
2013-10-31 18:47:11,621 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0042
2013-10-31 18:47:11,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:49491 dest: /127.0.0.1:54365
2013-10-31 18:47:11,622 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [left+right] submitted hadoop job: job_20131031182606197_0042
2013-10-31 18:47:11,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:52121 dest: /127.0.0.1:34578
2013-10-31 18:47:11,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_7668973597655018822_1422 src: /127.0.0.1:49210 dest: /127.0.0.1:37740
2013-10-31 18:47:11,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49210, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_7668973597655018822_1422, duration: 420301
2013-10-31 18:47:11,629 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,629 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52121, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_7668973597655018822_1422, duration: 1189586
2013-10-31 18:47:11,630 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,630 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,630 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49491, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7668973597655018822_1422, duration: 2200795
2013-10-31 18:47:11,631 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_7668973597655018822_1422 terminating
2013-10-31 18:47:11,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,633 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,634 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:11,634 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:11,635 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_7668973597655018822_1422 size 116
2013-10-31 18:47:11,642 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken
2013-10-31 18:47:11,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.splitmetainfo dst=null perm=null
2013-10-31 18:47:11,646 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52123, bytes: 48, op: HDFS_READ, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_2605274129487483737_1416, duration: 259136
2013-10-31 18:47:11,646 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0041 = 131. Number of splits = 1
2013-10-31 18:47:11,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0041_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:11,647 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0041 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:11,648 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0041 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:47:11,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,656 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml. blk_5835570393058213680_1424
2013-10-31 18:47:11,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:45321 dest: /127.0.0.1:59471
2013-10-31 18:47:11,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:49213 dest: /127.0.0.1:37740
2013-10-31 18:47:11,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5835570393058213680_1424 src: /127.0.0.1:49497 dest: /127.0.0.1:54365
2013-10-31 18:47:11,666 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49497, dest: /127.0.0.1:54365, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5835570393058213680_1424, duration: 949622
2013-10-31 18:47:11,666 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,667 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49213, dest: /127.0.0.1:37740, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_5835570393058213680_1424, duration: 1828402
2013-10-31 18:47:11,667 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,668 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45321, dest: /127.0.0.1:59471, bytes: 28167, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5835570393058213680_1424, duration: 2930535
2013-10-31 18:47:11,668 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5835570393058213680_1424 terminating
2013-10-31 18:47:11,668 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,671 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,672 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5835570393058213680_1424 size 28167
2013-10-31 18:47:11,672 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml from client DFSClient_1645291425
2013-10-31 18:47:11,673 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_conf.xml is closed by DFSClient_1645291425
2013-10-31 18:47:11,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:11,683 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken. blk_92448142914914131_1425
2013-10-31 18:47:11,685 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:45324 dest: /127.0.0.1:59471
2013-10-31 18:47:11,686 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:49499 dest: /127.0.0.1:54365
2013-10-31 18:47:11,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_92448142914914131_1425 src: /127.0.0.1:52129 dest: /127.0.0.1:34578
2013-10-31 18:47:11,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52129, dest: /127.0.0.1:34578, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_92448142914914131_1425, duration: 552703
2013-10-31 18:47:11,692 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,692 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49499, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_92448142914914131_1425, duration: 1303032
2013-10-31 18:47:11,693 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,693 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45324, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_92448142914914131_1425, duration: 2171728
2013-10-31 18:47:11,693 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,694 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_92448142914914131_1425 terminating
2013-10-31 18:47:11,696 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,697 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_92448142914914131_1425 size 116
2013-10-31 18:47:11,698 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:11,698 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:12,041 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken
2013-10-31 18:47:12,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.splitmetainfo dst=null perm=null
2013-10-31 18:47:12,045 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45327, bytes: 48, op: HDFS_READ, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5953021751685955983_1418, duration: 264329
2013-10-31 18:47:12,045 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0042 = 131. Number of splits = 1
2013-10-31 18:47:12,045 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0042_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:12,046 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0042 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:12,047 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0042 initialized successfully with 1 map tasks and 0 reduce tasks.
2013-10-31 18:47:12,051 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809) Starting thread to transfer block blk_-2565091071161671132_1412 to 127.0.0.1:54365
2013-10-31 18:47:12,053 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2565091071161671132_1412 src: /127.0.0.1:49502 dest: /127.0.0.1:54365
2013-10-31 18:47:12,054 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:59471, storageID=DS-955759156-10.5.128.102-59471-1383243965559, infoPort=57157, ipcPort=33809):Transmitted block blk_-2565091071161671132_1412 to /127.0.0.1:54365
2013-10-31 18:47:12,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_-2565091071161671132_1412 src: /127.0.0.1:49502 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:47:12,059 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2565091071161671132_1412 size 238055
2013-10-31 18:47:12,449 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data1/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:12,449 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_1798187280963192099_1403 file build/test/data/dfs/data/data2/current/blk_1798187280963192099 for deletion
2013-10-31 18:47:12,449 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data1/current/blk_-6312158700066968443
2013-10-31 18:47:12,449 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_4924507397654323874_1405 file build/test/data/dfs/data/data2/current/blk_4924507397654323874 for deletion
2013-10-31 18:47:12,449 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_1798187280963192099_1403 at file build/test/data/dfs/data/data2/current/blk_1798187280963192099
2013-10-31 18:47:12,450 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7803140496788561719_1406 file build/test/data/dfs/data/data1/current/blk_7803140496788561719 for deletion
2013-10-31 18:47:12,450 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_4924507397654323874_1405 at file build/test/data/dfs/data/data2/current/blk_4924507397654323874
2013-10-31 18:47:12,450 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7967776557441908343_1404 file build/test/data/dfs/data/data1/current/blk_7967776557441908343 for deletion
2013-10-31 18:47:12,450 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7803140496788561719_1406 at file build/test/data/dfs/data/data1/current/blk_7803140496788561719
2013-10-31 18:47:12,451 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7967776557441908343_1404 at file build/test/data/dfs/data/data1/current/blk_7967776557441908343
2013-10-31 18:47:13,256 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0041_m_000002_0' to tip task_20131031182606197_0041_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:13,262 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:13,262 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,263 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041/jobToken dst=null perm=null
2013-10-31 18:47:13,271 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49503, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_7668973597655018822_1422, duration: 356123
2013-10-31 18:47:13,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.xml dst=null perm=null
2013-10-31 18:47:13,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52134, bytes: 28318, op: HDFS_READ, cliID: DFSClient_436831636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8036325246898089699_1418, duration: 373943
2013-10-31 18:47:13,308 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:13,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.jar dst=null perm=null
2013-10-31 18:47:13,341 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52135, bytes: 239915, op: HDFS_READ, cliID: DFSClient_436831636, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2565091071161671132_1412, duration: 1436074
2013-10-31 18:47:13,435 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0040_m_-976513709
2013-10-31 18:47:13,447 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8733 with signal TERM. Exit code 0
2013-10-31 18:47:13,447 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:13,448 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0041_m_-941277400 spawned.
2013-10-31 18:47:13,451 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0041/attempt_20131031182606197_0041_m_000002_0/taskjvm.sh
2013-10-31 18:47:13,617 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_3570503195496497577_1413 to datanode(s) 127.0.0.1:54365
2013-10-31 18:47:13,618 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-6312158700066968443_1409
2013-10-31 18:47:13,927 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0042_m_000002_0' to tip task_20131031182606197_0042_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:13,930 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:13,930 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,930 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000002_0 which needs 1 slots
2013-10-31 18:47:13,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042/jobToken dst=null perm=null
2013-10-31 18:47:13,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45333, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_92448142914914131_1425, duration: 153591
2013-10-31 18:47:13,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.xml dst=null perm=null
2013-10-31 18:47:13,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52138, bytes: 28322, op: HDFS_READ, cliID: DFSClient_370820543, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-812474416209307718_1420, duration: 200164
2013-10-31 18:47:13,951 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:13,951 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:13,951 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:13,952 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-976513709 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:13,952 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:13,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.jar dst=null perm=null
2013-10-31 18:47:13,966 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52139, bytes: 239915, op: HDFS_READ, cliID: DFSClient_370820543, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3570503195496497577_1413, duration: 594921
2013-10-31 18:47:14,016 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0042_m_-1590574539
2013-10-31 18:47:14,016 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0042_m_-1590574539 spawned.
2013-10-31 18:47:14,017 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0042/attempt_20131031182606197_0042_m_000002_0/taskjvm.sh
2013-10-31 18:47:14,678 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_-941277400 given task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:15,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-6312158700066968443_1409 file build/test/data/dfs/data/data5/current/blk_-6312158700066968443 for deletion
2013-10-31 18:47:15,052 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-6312158700066968443_1409 at file build/test/data/dfs/data/data5/current/blk_-6312158700066968443
2013-10-31 18:47:15,078 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1590574539 given task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:15,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:15,251 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,251 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0040_m_000004_0 not found in cache
2013-10-31 18:47:15,251 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635251
2013-10-31 18:47:15,450 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_3570503195496497577_1413 to 127.0.0.1:54365
2013-10-31 18:47:15,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3570503195496497577_1413 src: /127.0.0.1:49515 dest: /127.0.0.1:54365
2013-10-31 18:47:15,452 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_3570503195496497577_1413 to /127.0.0.1:54365
2013-10-31 18:47:15,453 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_3570503195496497577_1413 src: /127.0.0.1:49515 dest: /127.0.0.1:54365 of size 238055
2013-10-31 18:47:15,457 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3570503195496497577_1413 size 238055
2013-10-31 18:47:15,477 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_r_-378893990 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:15,484 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9178 with signal TERM. Exit code 0
2013-10-31 18:47:15,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:15,637 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:15,637 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:15,637 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:15,637 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_r_-378893990 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:15,752 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_1560840909 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:15,761 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8893 with signal TERM. Exit code 0
2013-10-31 18:47:15,925 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,926 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635926
2013-10-31 18:47:15,929 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:15,930 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331635930
2013-10-31 18:47:15,943 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:15,943 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:15,943 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:15,944 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_1560840909 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:16,006 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0040
2013-10-31 18:47:16,007 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0040 for user-log deletion with retainTimeStamp:1383331636007
2013-10-31 18:47:16,016 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_85603554 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,025 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group8994 with signal TERM. Exit code 0
2013-10-31 18:47:16,148 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_-512244477 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,154 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0040_m_-1744508755 since job job_20131031182606197_0040 is dead
2013-10-31 18:47:16,157 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9036 with signal TERM. Exit code 0
2013-10-31 18:47:16,159 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9035 with signal TERM. Exit code 0
2013-10-31 18:47:16,230 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,230 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,230 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:16,231 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_85603554 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:16,365 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,365 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,365 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:16,366 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-1744508755 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:16,379 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:16,379 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:16,379 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:16,380 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0040_m_-512244477 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:18,098 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000002_0 0.0% setup
2013-10-31 18:47:18,101 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000002_0 is done.
2013-10-31 18:47:18,102 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000002_0 was -1
2013-10-31 18:47:18,102 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:18,498 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000002_0 0.0% setup
2013-10-31 18:47:18,500 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000002_0 is done.
2013-10-31 18:47:18,500 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000002_0 was -1
2013-10-31 18:47:18,501 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:19,266 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000002_0' has completed task_20131031182606197_0041_m_000002 successfully.
2013-10-31 18:47:19,270 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0041_m_000000_0' to tip task_20131031182606197_0041_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:19,271 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0041_m_000000
2013-10-31 18:47:19,272 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:19,272 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,273 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,316 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0041_m_731880323
2013-10-31 18:47:19,317 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0041_m_731880323 spawned.
2013-10-31 18:47:19,320 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0041/attempt_20131031182606197_0041_m_000000_0/taskjvm.sh
2013-10-31 18:47:19,936 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000002_0' has completed task_20131031182606197_0042_m_000002 successfully.
2013-10-31 18:47:19,938 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0042_m_000000_0' to tip task_20131031182606197_0042_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:19,938 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0042_m_000000
2013-10-31 18:47:19,940 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:19,940 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,940 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000000_0 which needs 1 slots
2013-10-31 18:47:19,955 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0042_m_-1110644511
2013-10-31 18:47:19,956 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0042_m_-1110644511 spawned.
2013-10-31 18:47:19,957 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0042/attempt_20131031182606197_0042_m_000000_0/taskjvm.sh
2013-10-31 18:47:20,388 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_731880323 given task: attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:20,796 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1110644511 given task: attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:20,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041/job.split dst=null perm=null
2013-10-31 18:47:20,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52149, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3499764083074527036_1415, duration: 185487
2013-10-31 18:47:20,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000 dst=null perm=null
2013-10-31 18:47:20,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49521, bytes: 135, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3095433216454494385_1410, duration: 121173
2013-10-31 18:47:20,954 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(1106)) - Number of transactions: 2222 Total time for transactions(ms): 38Number of transactions batched in Syncs: 184 Number of syncs: 1563 SyncTimes(ms): 88927 20659
2013-10-31 18:47:20,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:20,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:21,153 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000. blk_-7992408142071818202_1426
2013-10-31 18:47:21,180 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:49522 dest: /127.0.0.1:54365
2013-10-31 18:47:21,181 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:45349 dest: /127.0.0.1:59471
2013-10-31 18:47:21,182 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-7992408142071818202_1426 src: /127.0.0.1:52153 dest: /127.0.0.1:34578
2013-10-31 18:47:21,184 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52153, dest: /127.0.0.1:34578, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7992408142071818202_1426, duration: 1081310
2013-10-31 18:47:21,185 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,185 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45349, dest: /127.0.0.1:59471, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-7992408142071818202_1426, duration: 1452530
2013-10-31 18:47:21,185 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,185 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49522, dest: /127.0.0.1:54365, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0041_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7992408142071818202_1426, duration: 1844483
2013-10-31 18:47:21,185 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-7992408142071818202_1426 terminating
2013-10-31 18:47:21,186 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,186 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:21,186 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:21,189 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,189 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-7992408142071818202_1426 size 16
2013-10-31 18:47:21,234 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0041_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:21,234 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000000_0 0.0%
2013-10-31 18:47:21,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042/job.split dst=null perm=null
2013-10-31 18:47:21,302 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52155, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-5014300393221569912_1416, duration: 118353
2013-10-31 18:47:21,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000 dst=null perm=null
2013-10-31 18:47:21,341 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52156, bytes: 135, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3095433216454494385_1410, duration: 257760
2013-10-31 18:47:21,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:21,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:21,573 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000. blk_506252283718536132_1427
2013-10-31 18:47:21,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:52157 dest: /127.0.0.1:34578
2013-10-31 18:47:21,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:49529 dest: /127.0.0.1:54365
2013-10-31 18:47:21,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_506252283718536132_1427 src: /127.0.0.1:49247 dest: /127.0.0.1:37740
2013-10-31 18:47:21,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49247, dest: /127.0.0.1:37740, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_506252283718536132_1427, duration: 1203618
2013-10-31 18:47:21,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49529, dest: /127.0.0.1:54365, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_506252283718536132_1427, duration: 1379052
2013-10-31 18:47:21,614 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,614 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52157, dest: /127.0.0.1:34578, bytes: 17, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0042_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_506252283718536132_1427, duration: 1794018
2013-10-31 18:47:21,615 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_506252283718536132_1427 terminating
2013-10-31 18:47:21,615 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,615 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:21,616 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:21,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,617 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_506252283718536132_1427 size 17
2013-10-31 18:47:21,663 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0042_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:21,663 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000000_0 0.0%
2013-10-31 18:47:22,278 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0041_m_000000_0
2013-10-31 18:47:22,944 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0042_m_000000_0
2013-10-31 18:47:23,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0 dst=null perm=null
2013-10-31 18:47:23,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:23,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:23,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary/_attempt_20131031182606197_0041_m_000000_0 dst=null perm=null
2013-10-31 18:47:23,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0 dst=null perm=null
2013-10-31 18:47:23,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:23,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:23,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary/_attempt_20131031182606197_0042_m_000000_0 dst=null perm=null
2013-10-31 18:47:23,816 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000:0+131
2013-10-31 18:47:23,818 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000000_0 is done.
2013-10-31 18:47:23,818 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000000_0 was -1
2013-10-31 18:47:23,818 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:24,230 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000000_0 1.0% hdfs://localhost:34237/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1/part-00000:0+131
2013-10-31 18:47:24,232 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000000_0 is done.
2013-10-31 18:47:24,232 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000000_0 was -1
2013-10-31 18:47:24,232 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:24,273 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:24,273 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0041_m_000002_0
2013-10-31 18:47:24,273 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000002_0 not found in cache
2013-10-31 18:47:24,940 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:24,940 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0042_m_000002_0
2013-10-31 18:47:24,941 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000002_0 not found in cache
2013-10-31 18:47:25,282 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000000_0' has completed task_20131031182606197_0041_m_000000 successfully.
2013-10-31 18:47:25,541 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0041_m_000001_0' to tip task_20131031182606197_0041_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:25,543 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0041_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:25,543 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0041_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,543 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0041_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,701 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0041/attempt_20131031182606197_0041_m_000001_0. Attempting to reuse: jvm_20131031182606197_0041_m_731880323
2013-10-31 18:47:25,871 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0041_m_731880323 given task: attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:25,946 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000000_0' has completed task_20131031182606197_0042_m_000000 successfully.
2013-10-31 18:47:25,947 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0042_m_000001_0' to tip task_20131031182606197_0042_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:25,948 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0042_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:25,948 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0042_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,948 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0042_m_000001_0 which needs 1 slots
2013-10-31 18:47:25,983 INFO mapred.JvmManager (JvmManager.java:reapJvm(354)) - No new JVM spawned for jobId/taskid: job_20131031182606197_0042/attempt_20131031182606197_0042_m_000001_0. Attempting to reuse: jvm_20131031182606197_0042_m_-1590574539
2013-10-31 18:47:25,998 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000001_0 0.0%
2013-10-31 18:47:26,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary dst=null perm=null
2013-10-31 18:47:26,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:26,323 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS from client DFSClient_attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:26,323 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0041_m_000001_0
2013-10-31 18:47:26,546 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,547 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,547 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,547 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2565091071161671132 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,547 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,548 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,548 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,548 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3499764083074527036 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,548 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,549 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,549 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_2605274129487483737 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,549 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,549 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,550 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8036325246898089699 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0041 dst=null perm=null
2013-10-31 18:47:26,560 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0042_m_-1590574539 given task: attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,663 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000001_0 0.0%
2013-10-31 18:47:26,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary dst=null perm=null
2013-10-31 18:47:26,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:26,794 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS from client DFSClient_attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,795 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0042_m_000001_0
2013-10-31 18:47:26,836 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,837 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,837 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,837 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3570503195496497577 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,837 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,838 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,838 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,838 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-5014300393221569912 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,838 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:26,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_5953021751685955983 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:26,839 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:26,840 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-812474416209307718 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:26,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0042 dst=null perm=null
2013-10-31 18:47:28,621 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_5953021751685955983_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_-5014300393221569912_1416
2013-10-31 18:47:28,622 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_-5014300393221569912_1416
2013-10-31 18:47:28,940 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0041_m_000001_0 0.0% cleanup
2013-10-31 18:47:28,942 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0041_m_000001_0 is done.
2013-10-31 18:47:28,942 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0041_m_000001_0 was -1
2013-10-31 18:47:28,942 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:29,329 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data3/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:29,329 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data3/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:29,329 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data3/current/blk_-5014300393221569912
2013-10-31 18:47:29,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data3/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:29,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data3/current/blk_-2565091071161671132
2013-10-31 18:47:29,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data4/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:29,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data3/current/blk_-812474416209307718
2013-10-31 18:47:29,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data4/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:29,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data4/current/blk_3499764083074527036
2013-10-31 18:47:29,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data4/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:29,331 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data4/current/blk_3570503195496497577
2013-10-31 18:47:29,332 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data4/current/blk_5953021751685955983
2013-10-31 18:47:29,635 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0042_m_000001_0 0.0% cleanup
2013-10-31 18:47:29,636 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0042_m_000001_0 is done.
2013-10-31 18:47:29,636 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0042_m_000001_0 was -1
2013-10-31 18:47:29,637 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:30,528 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data8/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:30,528 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data8/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:30,528 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data8/current/blk_-8036325246898089699
2013-10-31 18:47:30,528 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data7/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:30,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data8/current/blk_-5014300393221569912
2013-10-31 18:47:30,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data7/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:30,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data7/current/blk_-2565091071161671132
2013-10-31 18:47:30,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data7/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:30,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data7/current/blk_-812474416209307718
2013-10-31 18:47:30,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data7/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:30,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data7/current/blk_2605274129487483737
2013-10-31 18:47:30,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data8/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:30,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data7/current/blk_3499764083074527036
2013-10-31 18:47:30,531 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data8/current/blk_3570503195496497577
2013-10-31 18:47:31,551 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0041_m_000001_0' has completed task_20131031182606197_0041_m_000001 successfully.
2013-10-31 18:47:31,552 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0041 has completed successfully.
2013-10-31 18:47:31,552 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0041,submitTime=1383245231516,launchTime=1383245231648,firstMapTaskLaunchTime=1383245239269,firstJobSetupTaskLaunchTime=1383245233256,firstJobCleanupTaskLaunchTime=1383245245541,finishTime=1383245251552,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/2CF6A93BE5C94AF5A38BCEE45A34C4F2] left+right/(3/3) ...dpipesplatform/splitcomp1
2013-10-31 18:47:31,561 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5. blk_-159153927451386666_1429
2013-10-31 18:47:31,563 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:52164 dest: /127.0.0.1:34578
2013-10-31 18:47:31,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:45362 dest: /127.0.0.1:59471
2013-10-31 18:47:31,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-159153927451386666_1429 src: /127.0.0.1:49537 dest: /127.0.0.1:54365
2013-10-31 18:47:31,573 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49537, dest: /127.0.0.1:54365, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-159153927451386666_1429, duration: 2709283
2013-10-31 18:47:31,573 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,574 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45362, dest: /127.0.0.1:59471, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-159153927451386666_1429, duration: 3517259
2013-10-31 18:47:31,574 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,575 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,575 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52164, dest: /127.0.0.1:34578, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_747896772, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-159153927451386666_1429, duration: 4417732
2013-10-31 18:47:31,576 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-159153927451386666_1429 terminating
2013-10-31 18:47:31,581 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,581 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 from client DFSClient_747896772
2013-10-31 18:47:31,582 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_logs/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 is closed by DFSClient_747896772
2013-10-31 18:47:31,582 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-159153927451386666_1429 size 11318
2013-10-31 18:47:31,588 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0041_1383245231516_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2F2CF6A93BE5C94AF5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:31,588 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000000_0'
2013-10-31 18:47:31,588 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000001_0'
2013-10-31 18:47:31,589 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0041_m_000002_0'
2013-10-31 18:47:31,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:31,590 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:31,591 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_7668973597655018822 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:31,593 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0041_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:31,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0041 dst=null perm=null
2013-10-31 18:47:31,622 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_5953021751685955983_1418 blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-2565091071161671132_1412 blk_-5014300393221569912_1416
2013-10-31 18:47:31,622 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_7668973597655018822_1422
2013-10-31 18:47:31,955 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0042_m_000001_0' has completed task_20131031182606197_0042_m_000001 successfully.
2013-10-31 18:47:31,988 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0042 has completed successfully.
2013-10-31 18:47:31,989 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0042,submitTime=1383245231584,launchTime=1383245232046,firstMapTaskLaunchTime=1383245239938,firstJobSetupTaskLaunchTime=1383245233927,firstJobCleanupTaskLaunchTime=1383245245947,finishTime=1383245251988,numMaps=1,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=12,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[FFFD8058FD054FB8AFF66C79650750C9/B0D9C4DEE0F64FA5A95F1E146F5A59A3] left+right/(2/3) ...dpipesplatform/splitcomp2
2013-10-31 18:47:31,993 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5. blk_-762236133339504791_1429
2013-10-31 18:47:31,996 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:45366 dest: /127.0.0.1:59471
2013-10-31 18:47:32,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:49258 dest: /127.0.0.1:37740
2013-10-31 18:47:32,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-762236133339504791_1429 src: /127.0.0.1:49542 dest: /127.0.0.1:54365
2013-10-31 18:47:32,006 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49542, dest: /127.0.0.1:54365, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-762236133339504791_1429, duration: 339663
2013-10-31 18:47:32,006 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,007 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49258, dest: /127.0.0.1:37740, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-762236133339504791_1429, duration: 784994
2013-10-31 18:47:32,007 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,008 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45366, dest: /127.0.0.1:59471, bytes: 11318, op: HDFS_WRITE, cliID: DFSClient_1645291425, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-762236133339504791_1429, duration: 1848317
2013-10-31 18:47:32,008 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-762236133339504791_1429 terminating
2013-10-31 18:47:32,010 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,012 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 from client DFSClient_1645291425
2013-10-31 18:47:32,012 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_logs/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 is closed by DFSClient_1645291425
2013-10-31 18:47:32,012 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-762236133339504791_1429 size 11318
2013-10-31 18:47:32,019 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0042_1383245231584_hadoop_%5BFFFD8058FD054FB8AFF66C79650750C9%2FB0D9C4DEE0F64FA5 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:32,019 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,020 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000000_0'
2013-10-31 18:47:32,020 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_92448142914914131 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,020 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000001_0'
2013-10-31 18:47:32,020 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0042_m_000002_0'
2013-10-31 18:47:32,020 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0042_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:32,021 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:32,021 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:32,022 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:32,022 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:32,022 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:32,022 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:32,023 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:32,023 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:32,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0042 dst=null perm=null
2013-10-31 18:47:32,027 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8506542354890884660 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8600798403005839553 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:32,028 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3095433216454494385 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:32,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hadoop/6262220135_split_6D8D6044AEF34B51A25BAEF301B42AF1 dst=null perm=null
2013-10-31 18:47:32,033 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/_temporary
2013-10-31 18:47:32,035 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/_temporary
2013-10-31 18:47:32,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1 dst=null perm=null
2013-10-31 18:47:32,045 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000 dst=null perm=null
2013-10-31 18:47:32,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000 dst=null perm=null
2013-10-31 18:47:32,049 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49543, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-7992408142071818202_1426, duration: 289406
2013-10-31 18:47:32,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2 dst=null perm=null
2013-10-31 18:47:32,058 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000 dst=null perm=null
2013-10-31 18:47:32,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000 dst=null perm=null
2013-10-31 18:47:32,061 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52173, bytes: 21, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_506252283718536132_1427, duration: 265342
2013-10-31 18:47:32,061 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitcomp2
2013-10-31 18:47:32,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2 dst=null perm=null
2013-10-31 18:47:32,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp2/part-00000 dst=null perm=null
2013-10-31 18:47:32,065 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/splitcomp1
2013-10-31 18:47:32,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49545, bytes: 21, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_506252283718536132_1427, duration: 276104
2013-10-31 18:47:32,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1 dst=null perm=null
2013-10-31 18:47:32,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/splitcomp1/part-00000 dst=null perm=null
2013-10-31 18:47:32,069 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52175, bytes: 20, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-7992408142071818202_1426, duration: 272977
2013-10-31 18:47:32,077 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(319)) - using default application jar, may cause class not found exceptions on the cluster
2013-10-31 18:47:32,077 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(203)) - using application jar: /home/hadoop/.gradle/caches/artifacts-26/filestore/cascading/cascading-hadoop/2.2.0/jar/c7b52bd4c6da523ebde0a5d6eca2475123783db2/cascading-hadoop-2.2.0.jar
2013-10-31 18:47:32,088 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting
2013-10-31 18:47:32,089 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] source: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt"]
2013-10-31 18:47:32,089 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] sink: Hfs["TextLine[['line']->[ALL]]"]["/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup"]
2013-10-31 18:47:32,089 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] parallel execution is enabled: true
2013-10-31 18:47:32,089 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] starting jobs: 1
2013-10-31 18:47:32,089 INFO flow.Flow (BaseFlow.java:logInfo(1306)) - [test] allocating threads: 1
2013-10-31 18:47:32,091 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] starting step: (1/1) ...ldedpipesplatform/nogroup
2013-10-31 18:47:32,094 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(825)) - Default number of map tasks: 4
2013-10-31 18:47:32,094 INFO mapred.JobClient (JobClient.java:setNumTasksBasedOnClusterCapacity(832)) - Default number of reduce tasks: 0
2013-10-31 18:47:32,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:32,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043 dst=null perm=hadoop:supergroup:rwx------
2013-10-31 18:47:32,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,113 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar. blk_6803672974736063903_1430
2013-10-31 18:47:32,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:49547 dest: /127.0.0.1:54365
2013-10-31 18:47:32,116 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:49265 dest: /127.0.0.1:37740
2013-10-31 18:47:32,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:52178 dest: /127.0.0.1:34578
2013-10-31 18:47:32,129 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52178, dest: /127.0.0.1:34578, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6803672974736063903_1430, duration: 8686768
2013-10-31 18:47:32,130 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,130 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49265, dest: /127.0.0.1:37740, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 9423868
2013-10-31 18:47:32,131 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,131 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49547, dest: /127.0.0.1:54365, bytes: 238055, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6803672974736063903_1430, duration: 10561827
2013-10-31 18:47:32,131 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,132 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_6803672974736063903_1430 terminating
2013-10-31 18:47:32,135 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,135 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar from client DFSClient_-1596270109
2013-10-31 18:47:32,136 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar is closed by DFSClient_-1596270109
2013-10-31 18:47:32,136 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:32,141 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar. New replication is 10
2013-10-31 18:47:32,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=null
2013-10-31 18:47:32,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,154 INFO mapred.JobClient (JobClient.java:copyAndConfigureFiles(794)) - Setting group to hadoop
2013-10-31 18:47:32,158 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 1
2013-10-31 18:47:32,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:47:32,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,175 INFO namenode.FSNamesystem (FSNamesystem.java:setReplicationInternal(1135)) - Increasing replication for file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split. New replication is 10
2013-10-31 18:47:32,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setReplication src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=null
2013-10-31 18:47:32,183 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split. blk_-2476631661436009888_1431
2013-10-31 18:47:32,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:49550 dest: /127.0.0.1:54365
2013-10-31 18:47:32,186 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:52180 dest: /127.0.0.1:34578
2013-10-31 18:47:32,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:45378 dest: /127.0.0.1:59471
2013-10-31 18:47:32,189 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-2476631661436009888_1431 src: /127.0.0.1:49270 dest: /127.0.0.1:37740
2013-10-31 18:47:32,192 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49270, dest: /127.0.0.1:37740, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2476631661436009888_1431, duration: 124165
2013-10-31 18:47:32,193 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,193 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45378, dest: /127.0.0.1:59471, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2476631661436009888_1431, duration: 969633
2013-10-31 18:47:32,194 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,194 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52180, dest: /127.0.0.1:34578, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-2476631661436009888_1431, duration: 1944626
2013-10-31 18:47:32,195 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,195 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,195 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49550, dest: /127.0.0.1:54365, bytes: 1403, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 2910350
2013-10-31 18:47:32,196 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 3 for block blk_-2476631661436009888_1431 terminating
2013-10-31 18:47:32,196 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,198 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split from client DFSClient_-1596270109
2013-10-31 18:47:32,198 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split is closed by DFSClient_-1596270109
2013-10-31 18:47:32,198 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,199 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-2476631661436009888_1431 size 1403
2013-10-31 18:47:32,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,220 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo. blk_3823188869741882486_1432
2013-10-31 18:47:32,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:52183 dest: /127.0.0.1:34578
2013-10-31 18:47:32,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:45381 dest: /127.0.0.1:59471
2013-10-31 18:47:32,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_3823188869741882486_1432 src: /127.0.0.1:49556 dest: /127.0.0.1:54365
2013-10-31 18:47:32,228 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49556, dest: /127.0.0.1:54365, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3823188869741882486_1432, duration: 69801
2013-10-31 18:47:32,228 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,228 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45381, dest: /127.0.0.1:59471, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_3823188869741882486_1432, duration: 878974
2013-10-31 18:47:32,229 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,229 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52183, dest: /127.0.0.1:34578, bytes: 156, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_3823188869741882486_1432, duration: 1714740
2013-10-31 18:47:32,230 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_3823188869741882486_1432 terminating
2013-10-31 18:47:32,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,234 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,235 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_3823188869741882486_1432 size 156
2013-10-31 18:47:32,235 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo from client DFSClient_-1596270109
2013-10-31 18:47:32,236 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo is closed by DFSClient_-1596270109
2013-10-31 18:47:32,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data4/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:32,330 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data4/current/blk_7668973597655018822
2013-10-31 18:47:32,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=setPermission src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,640 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml. blk_-8952370825653875016_1433
2013-10-31 18:47:32,642 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:49274 dest: /127.0.0.1:37740
2013-10-31 18:47:32,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:45384 dest: /127.0.0.1:59471
2013-10-31 18:47:32,645 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8952370825653875016_1433 src: /127.0.0.1:52188 dest: /127.0.0.1:34578
2013-10-31 18:47:32,649 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52188, dest: /127.0.0.1:34578, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 892146
2013-10-31 18:47:32,650 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,650 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45384, dest: /127.0.0.1:59471, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8952370825653875016_1433, duration: 1730220
2013-10-31 18:47:32,651 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,651 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,651 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49274, dest: /127.0.0.1:37740, bytes: 27340, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 2734056
2013-10-31 18:47:32,651 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,651 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8952370825653875016_1433 terminating
2013-10-31 18:47:32,653 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml from client DFSClient_-1596270109
2013-10-31 18:47:32,654 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml is closed by DFSClient_-1596270109
2013-10-31 18:47:32,654 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8952370825653875016_1433 size 27340
2013-10-31 18:47:32,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=null
2013-10-31 18:47:32,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45387, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-347020941, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8952370825653875016_1433, duration: 392250
2013-10-31 18:47:32,689 INFO mapred.JobInProgress (JobInProgress.java:checkTaskLimits(781)) - job_20131031182606197_0043: nMaps=4 nReduces=0 max=-1
2013-10-31 18:47:32,689 INFO mapred.JobTracker (JobTracker.java:addJob(4075)) - Job job_20131031182606197_0043 added successfully for user 'hadoop' to queue 'default'
2013-10-31 18:47:32,689 INFO mapred.JobTracker (JobTracker.java:initJob(4236)) - Initializing job_20131031182606197_0043
2013-10-31 18:47:32,690 INFO mapred.AuditLogger (AuditLogger.java:logSuccess(68)) - USER=hadoop IP=127.0.0.1 OPERATION=SUBMIT_JOB TARGET=job_20131031182606197_0043 RESULT=SUCCESS
2013-10-31 18:47:32,690 INFO mapred.JobInProgress (JobInProgress.java:initTasks(948)) - Initializing job_20131031182606197_0043
2013-10-31 18:47:32,691 INFO flow.FlowStep (BaseFlowStep.java:logInfo(742)) - [test] submitted hadoop job: job_20131031182606197_0043
2013-10-31 18:47:32,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,722 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml. blk_4160337422610249261_1435
2013-10-31 18:47:32,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:49279 dest: /127.0.0.1:37740
2013-10-31 18:47:32,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:52192 dest: /127.0.0.1:34578
2013-10-31 18:47:32,727 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_4160337422610249261_1435 src: /127.0.0.1:49564 dest: /127.0.0.1:54365
2013-10-31 18:47:32,731 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49564, dest: /127.0.0.1:54365, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_4160337422610249261_1435, duration: 795014
2013-10-31 18:47:32,731 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,732 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52192, dest: /127.0.0.1:34578, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_4160337422610249261_1435, duration: 1613703
2013-10-31 18:47:32,732 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,733 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,733 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49279, dest: /127.0.0.1:37740, bytes: 27405, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_4160337422610249261_1435, duration: 2550728
2013-10-31 18:47:32,734 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,734 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_4160337422610249261_1435 terminating
2013-10-31 18:47:32,736 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml from client DFSClient_-347020941
2013-10-31 18:47:32,736 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_conf.xml is closed by DFSClient_-347020941
2013-10-31 18:47:32,737 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_4160337422610249261_1435 size 27405
2013-10-31 18:47:32,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:32,749 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken. blk_862287065973210454_1436
2013-10-31 18:47:32,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:49565 dest: /127.0.0.1:54365
2013-10-31 18:47:32,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:45392 dest: /127.0.0.1:59471
2013-10-31 18:47:32,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_862287065973210454_1436 src: /127.0.0.1:49284 dest: /127.0.0.1:37740
2013-10-31 18:47:32,756 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49284, dest: /127.0.0.1:37740, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 66329
2013-10-31 18:47:32,757 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,757 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45392, dest: /127.0.0.1:59471, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_862287065973210454_1436, duration: 849895
2013-10-31 18:47:32,758 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,758 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49565, dest: /127.0.0.1:54365, bytes: 116, op: HDFS_WRITE, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 1932846
2013-10-31 18:47:32,759 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,759 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_862287065973210454_1436 terminating
2013-10-31 18:47:32,761 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,761 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken from client DFSClient_-1596270109
2013-10-31 18:47:32,762 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken is closed by DFSClient_-1596270109
2013-10-31 18:47:32,762 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_862287065973210454_1436 size 116
2013-10-31 18:47:32,767 INFO mapred.JobInProgress (JobInProgress.java:generateAndStoreTokens(3803)) - jobToken generated and stored with users keys in /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken
2013-10-31 18:47:32,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.splitmetainfo dst=null perm=null
2013-10-31 18:47:32,771 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49568, bytes: 160, op: HDFS_READ, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_3823188869741882486_1432, duration: 261930
2013-10-31 18:47:32,772 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1000)) - Input size for job job_20131031182606197_0043 = 1449. Number of splits = 4
2013-10-31 18:47:32,773 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000000 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,773 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000001 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,774 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000002 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,775 INFO mapred.JobInProgress (JobInProgress.java:createCache(825)) - tip:task_20131031182606197_0043_m_000003 has split on node:/default-rack/127.0.0.1
2013-10-31 18:47:32,776 INFO mapred.JobInProgress (JobInProgress.java:createCache(855)) - job_20131031182606197_0043 LOCALITY_WAIT_FACTOR=1.0
2013-10-31 18:47:32,776 INFO mapred.JobInProgress (JobInProgress.java:initTasks(1079)) - Job job_20131031182606197_0043 initialized successfully with 4 map tasks and 0 reduce tasks.
2013-10-31 18:47:33,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data5/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:33,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data6/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:33,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data5/current/blk_-8036325246898089699
2013-10-31 18:47:33,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data5/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:33,059 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data6/current/blk_-5014300393221569912
2013-10-31 18:47:33,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data5/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:33,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data5/current/blk_-2565091071161671132
2013-10-31 18:47:33,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data5/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:33,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data5/current/blk_2605274129487483737
2013-10-31 18:47:33,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data6/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:33,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data5/current/blk_3499764083074527036
2013-10-31 18:47:33,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data6/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:33,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data6/current/blk_3570503195496497577
2013-10-31 18:47:33,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data6/current/blk_5953021751685955983
2013-10-31 18:47:34,595 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_SETUP) 'attempt_20131031182606197_0043_m_000005_0' to tip task_20131031182606197_0043_m_000005, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:34,600 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000005_0 task's state:UNASSIGNED
2013-10-31 18:47:34,601 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000005_0 which needs 1 slots
2013-10-31 18:47:34,601 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000005_0 which needs 1 slots
2013-10-31 18:47:34,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken dst=null perm=null
2013-10-31 18:47:34,610 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49290, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 290529
2013-10-31 18:47:34,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=null
2013-10-31 18:47:34,620 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49292, bytes: 27556, op: HDFS_READ, cliID: DFSClient_1286514459, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 375403
2013-10-31 18:47:34,623 INFO hdfs.StateChange (FSNamesystem.java:computeReplicationWorkForBlock(3078)) - BLOCK* ask 127.0.0.1:34578 to replicate blk_6803672974736063903_1430 to datanode(s) 127.0.0.1:59471
2013-10-31 18:47:34,624 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_7668973597655018822_1422 blk_-2565091071161671132_1412 blk_-812474416209307718_1420 blk_92448142914914131_1425 blk_3095433216454494385_1410 blk_-8600798403005839553_1408 blk_-5014300393221569912_1416 blk_5953021751685955983_1418 blk_-8036325246898089699_1418 blk_3570503195496497577_1413 blk_3499764083074527036_1415 blk_2605274129487483737_1416 blk_-8506542354890884660_1411
2013-10-31 18:47:34,624 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_7668973597655018822_1422 blk_3095433216454494385_1410
2013-10-31 18:47:34,648 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:34,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=null
2013-10-31 18:47:34,681 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49576, bytes: 239915, op: HDFS_READ, cliID: DFSClient_1286514459, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_6803672974736063903_1430, duration: 1425888
2013-10-31 18:47:34,781 INFO mapred.JvmManager (JvmManager.java:reapJvm(380)) - Killing JVM: jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:34,788 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9453 with signal TERM. Exit code 0
2013-10-31 18:47:34,789 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1588713849
2013-10-31 18:47:34,790 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1588713849 spawned.
2013-10-31 18:47:34,791 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000005_0/taskjvm.sh
2013-10-31 18:47:35,186 INFO mapred.TaskTracker (TaskTracker.java:getTask(3424)) - Killing unknown JVM jvm_20131031182606197_0041_m_-941277400
2013-10-31 18:47:35,818 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:35,818 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:35,818 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:35,818 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0041_m_-941277400 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:36,457 INFO datanode.DataNode (DataNode.java:transferBlock(1265)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357) Starting thread to transfer block blk_6803672974736063903_1430 to 127.0.0.1:59471
2013-10-31 18:47:36,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data2/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:36,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data1/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:36,457 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8036325246898089699_1418 file build/test/data/dfs/data/data2/current/blk_-8036325246898089699 for deletion
2013-10-31 18:47:36,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data2/current/blk_-8600798403005839553
2013-10-31 18:47:36,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data1/current/blk_-8506542354890884660
2013-10-31 18:47:36,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-5014300393221569912_1416 file build/test/data/dfs/data/data1/current/blk_-5014300393221569912 for deletion
2013-10-31 18:47:36,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8036325246898089699_1418 at file build/test/data/dfs/data/data2/current/blk_-8036325246898089699
2013-10-31 18:47:36,459 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-5014300393221569912_1416 at file build/test/data/dfs/data/data1/current/blk_-5014300393221569912
2013-10-31 18:47:36,459 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_6803672974736063903_1430 src: /127.0.0.1:45404 dest: /127.0.0.1:59471
2013-10-31 18:47:36,459 INFO datanode.DataNode (DataNode.java:run(1469)) - DatanodeRegistration(127.0.0.1:34578, storageID=DS-11064708-10.5.128.102-34578-1383243962924, infoPort=35620, ipcPort=60357):Transmitted block blk_6803672974736063903_1430 to /127.0.0.1:59471
2013-10-31 18:47:36,458 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2565091071161671132_1412 file build/test/data/dfs/data/data2/current/blk_-2565091071161671132 for deletion
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-812474416209307718_1420 file build/test/data/dfs/data/data1/current/blk_-812474416209307718 for deletion
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data2/current/blk_92448142914914131 for deletion
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2565091071161671132_1412 at file build/test/data/dfs/data/data2/current/blk_-2565091071161671132
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-812474416209307718_1420 at file build/test/data/dfs/data/data1/current/blk_-812474416209307718
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data2/current/blk_92448142914914131
2013-10-31 18:47:36,460 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_2605274129487483737_1416 file build/test/data/dfs/data/data2/current/blk_2605274129487483737 for deletion
2013-10-31 18:47:36,461 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data2/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:36,461 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_2605274129487483737_1416 at file build/test/data/dfs/data/data2/current/blk_2605274129487483737
2013-10-31 18:47:36,461 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3499764083074527036_1415 file build/test/data/dfs/data/data2/current/blk_3499764083074527036 for deletion
2013-10-31 18:47:36,461 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data2/current/blk_3095433216454494385
2013-10-31 18:47:36,461 INFO datanode.DataNode (DataXceiver.java:writeBlock(414)) - Received block blk_6803672974736063903_1430 src: /127.0.0.1:45404 dest: /127.0.0.1:59471 of size 238055
2013-10-31 18:47:36,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3499764083074527036_1415 at file build/test/data/dfs/data/data2/current/blk_3499764083074527036
2013-10-31 18:47:36,461 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3570503195496497577_1413 file build/test/data/dfs/data/data1/current/blk_3570503195496497577 for deletion
2013-10-31 18:47:36,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_5953021751685955983_1418 file build/test/data/dfs/data/data1/current/blk_5953021751685955983 for deletion
2013-10-31 18:47:36,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data1/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:36,462 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3570503195496497577_1413 at file build/test/data/dfs/data/data1/current/blk_3570503195496497577
2013-10-31 18:47:36,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_5953021751685955983_1418 at file build/test/data/dfs/data/data1/current/blk_5953021751685955983
2013-10-31 18:47:36,463 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data1/current/blk_7668973597655018822
2013-10-31 18:47:36,466 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_6803672974736063903_1430 size 238055
2013-10-31 18:47:36,488 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1588713849 given task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:36,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data8/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:36,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_7668973597655018822_1422 file build/test/data/dfs/data/data7/current/blk_7668973597655018822 for deletion
2013-10-31 18:47:36,529 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data8/current/blk_3095433216454494385
2013-10-31 18:47:36,530 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_7668973597655018822_1422 at file build/test/data/dfs/data/data7/current/blk_7668973597655018822
2013-10-31 18:47:36,590 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:36,591 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000000_0 not found in cache
2013-10-31 18:47:36,591 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0041_m_000001_0 not found in cache
2013-10-31 18:47:36,591 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0041 for user-log deletion with retainTimeStamp:1383331656591
2013-10-31 18:47:36,591 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:36,591 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0042 being deleted.
2013-10-31 18:47:36,980 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0041_m_731880323 since job job_20131031182606197_0041 is dead
2013-10-31 18:47:36,987 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9668 with signal TERM. Exit code 0
2013-10-31 18:47:37,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:37,021 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0042
2013-10-31 18:47:37,021 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000000_0 not found in cache
2013-10-31 18:47:37,021 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0042_m_000001_0 not found in cache
2013-10-31 18:47:37,022 INFO mapred.UserLogCleaner (UserLogCleaner.java:markJobLogsForDeletion(199)) - Adding job_20131031182606197_0042 for user-log deletion with retainTimeStamp:1383331657021
2013-10-31 18:47:37,022 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(2166)) - Received 'KillJobAction' for job: job_20131031182606197_0041
2013-10-31 18:47:37,022 WARN mapred.TaskTracker (TaskTracker.java:purgeJob(2173)) - Unknown job job_20131031182606197_0041 being deleted.
2013-10-31 18:47:37,139 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:37,139 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:37,139 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:37,139 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0041_m_731880323 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:37,625 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_92448142914914131_1425 blk_-8506542354890884660_1411 blk_3095433216454494385_1410 blk_-8600798403005839553_1408
2013-10-31 18:47:37,625 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_92448142914914131_1425 blk_-8506542354890884660_1411 blk_-8600798403005839553_1408
2013-10-31 18:47:37,675 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0042_m_-1590574539 since job job_20131031182606197_0042 is dead
2013-10-31 18:47:37,685 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9510 with signal TERM. Exit code 0
2013-10-31 18:47:37,896 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:37,896 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:37,896 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:37,896 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0042_m_-1590574539 exited with exit code 143. Number of tasks it ran: 2
2013-10-31 18:47:38,302 INFO mapred.TaskTracker (TaskTracker.java:getTask(3429)) - Killing JVM jvm_20131031182606197_0042_m_-1110644511 since job job_20131031182606197_0042 is dead
2013-10-31 18:47:38,312 INFO util.ProcessTree (ProcessTree.java:killProcessGroup(143)) - Killing process group9707 with signal TERM. Exit code 0
2013-10-31 18:47:38,332 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data3/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:38,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data3/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:38,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data3/current/blk_-8600798403005839553
2013-10-31 18:47:38,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data4/current/blk_92448142914914131 for deletion
2013-10-31 18:47:38,333 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data3/current/blk_-8506542354890884660
2013-10-31 18:47:38,334 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3095433216454494385_1410 file build/test/data/dfs/data/data4/current/blk_3095433216454494385 for deletion
2013-10-31 18:47:38,334 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data4/current/blk_92448142914914131
2013-10-31 18:47:38,335 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3095433216454494385_1410 at file build/test/data/dfs/data/data4/current/blk_3095433216454494385
2013-10-31 18:47:38,496 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_8597259860310358460_1102
2013-10-31 18:47:38,497 WARN mapred.DefaultTaskController (DefaultTaskController.java:launchTask(136)) - Exit code from task is : 143
2013-10-31 18:47:38,497 INFO mapred.DefaultTaskController (DefaultTaskController.java:launchTask(137)) - Output from DefaultTaskController's launchTask follows:
2013-10-31 18:47:38,497 INFO mapred.TaskController (TaskController.java:logOutput(249)) -
2013-10-31 18:47:38,497 INFO mapred.JvmManager (JvmManager.java:runChild(510)) - JVM : jvm_20131031182606197_0042_m_-1110644511 exited with exit code 143. Number of tasks it ran: 1
2013-10-31 18:47:39,060 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8600798403005839553_1408 file build/test/data/dfs/data/data6/current/blk_-8600798403005839553 for deletion
2013-10-31 18:47:39,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8506542354890884660_1411 file build/test/data/dfs/data/data6/current/blk_-8506542354890884660 for deletion
2013-10-31 18:47:39,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8600798403005839553_1408 at file build/test/data/dfs/data/data6/current/blk_-8600798403005839553
2013-10-31 18:47:39,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_92448142914914131_1425 file build/test/data/dfs/data/data6/current/blk_92448142914914131 for deletion
2013-10-31 18:47:39,061 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8506542354890884660_1411 at file build/test/data/dfs/data/data6/current/blk_-8506542354890884660
2013-10-31 18:47:39,062 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_92448142914914131_1425 at file build/test/data/dfs/data/data6/current/blk_92448142914914131
2013-10-31 18:47:39,928 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000005_0 0.0% setup
2013-10-31 18:47:39,930 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000005_0 is done.
2013-10-31 18:47:39,930 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000005_0 was -1
2013-10-31 18:47:39,931 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:40,608 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000005_0' has completed task_20131031182606197_0043_m_000005 successfully.
2013-10-31 18:47:40,613 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000000_0' to tip task_20131031182606197_0043_m_000000, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:48953'
2013-10-31 18:47:40,614 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000000
2013-10-31 18:47:40,616 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000000_0 task's state:UNASSIGNED
2013-10-31 18:47:40,616 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000000_0 which needs 1 slots
2013-10-31 18:47:40,616 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000000_0 which needs 1 slots
2013-10-31 18:47:40,646 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_1376735318
2013-10-31 18:47:40,647 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_1376735318 spawned.
2013-10-31 18:47:40,648 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/2_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000000_0/taskjvm.sh
2013-10-31 18:47:41,030 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000001_0' to tip task_20131031182606197_0043_m_000001, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:58210'
2013-10-31 18:47:41,031 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000001
2013-10-31 18:47:41,032 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000001_0 task's state:UNASSIGNED
2013-10-31 18:47:41,032 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000001_0 which needs 1 slots
2013-10-31 18:47:41,032 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000002_0' to tip task_20131031182606197_0043_m_000002, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:33516'
2013-10-31 18:47:41,032 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000001_0 which needs 1 slots
2013-10-31 18:47:41,032 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000002
2013-10-31 18:47:41,033 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (MAP) 'attempt_20131031182606197_0043_m_000003_0' to tip task_20131031182606197_0043_m_000003, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:47:41,033 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000002_0 task's state:UNASSIGNED
2013-10-31 18:47:41,034 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000002_0 which needs 1 slots
2013-10-31 18:47:41,034 INFO mapred.JobInProgress (JobInProgress.java:addRunningTaskToTIP(2098)) - Choosing rack-local task task_20131031182606197_0043_m_000003
2013-10-31 18:47:41,034 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000002_0 which needs 1 slots
2013-10-31 18:47:41,035 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000003_0 task's state:UNASSIGNED
2013-10-31 18:47:41,035 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000003_0 which needs 1 slots
2013-10-31 18:47:41,035 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000003_0 which needs 1 slots
2013-10-31 18:47:41,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken dst=null perm=null
2013-10-31 18:47:41,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken dst=null perm=null
2013-10-31 18:47:41,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043/jobToken dst=null perm=null
2013-10-31 18:47:41,038 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49580, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 144205
2013-10-31 18:47:41,038 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49581, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_862287065973210454_1436, duration: 128082
2013-10-31 18:47:41,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=null
2013-10-31 18:47:41,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=null
2013-10-31 18:47:41,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52213, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-1538069192, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 153316
2013-10-31 18:47:41,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49302, bytes: 27556, op: HDFS_READ, cliID: DFSClient_826029349, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8952370825653875016_1433, duration: 148967
2013-10-31 18:47:41,061 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,061 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=null
2013-10-31 18:47:41,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=null
2013-10-31 18:47:41,076 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49304, bytes: 120, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_862287065973210454_1436, duration: 134456
2013-10-31 18:47:41,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49305, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-1538069192, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 626655
2013-10-31 18:47:41,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49303, bytes: 239915, op: HDFS_READ, cliID: DFSClient_826029349, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_6803672974736063903_1430, duration: 640530
2013-10-31 18:47:41,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.xml dst=null perm=null
2013-10-31 18:47:41,081 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52219, bytes: 27556, op: HDFS_READ, cliID: DFSClient_-426393825, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8952370825653875016_1433, duration: 153457
2013-10-31 18:47:41,093 INFO mapred.JobLocalizer (JobLocalizer.java:createUserDirs(166)) - Initializing user hadoop on this TT.
2013-10-31 18:47:41,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.jar dst=null perm=null
2013-10-31 18:47:41,108 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52220, bytes: 239915, op: HDFS_READ, cliID: DFSClient_-426393825, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_6803672974736063903_1430, duration: 608406
2013-10-31 18:47:41,132 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-231425040
2013-10-31 18:47:41,132 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_157840219
2013-10-31 18:47:41,133 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-231425040 spawned.
2013-10-31 18:47:41,133 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_157840219 spawned.
2013-10-31 18:47:41,135 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/3_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000001_0/taskjvm.sh
2013-10-31 18:47:41,135 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/0_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000002_0/taskjvm.sh
2013-10-31 18:47:41,511 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_1376735318 given task: attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:42,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=null
2013-10-31 18:47:42,039 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49594, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 360156
2013-10-31 18:47:42,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:47:42,080 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49312, bytes: 429, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 250627
2013-10-31 18:47:42,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:42,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:42,773 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1910409010
2013-10-31 18:47:42,774 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1910409010 spawned.
2013-10-31 18:47:42,777 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000003_0/taskjvm.sh
2013-10-31 18:47:42,985 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000. blk_-8962913433765712905_1437
2013-10-31 18:47:43,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:45422 dest: /127.0.0.1:59471
2013-10-31 18:47:43,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:52226 dest: /127.0.0.1:34578
2013-10-31 18:47:43,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8962913433765712905_1437 src: /127.0.0.1:49315 dest: /127.0.0.1:37740
2013-10-31 18:47:43,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49315, dest: /127.0.0.1:37740, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 1212939
2013-10-31 18:47:43,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,013 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52226, dest: /127.0.0.1:34578, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8962913433765712905_1437, duration: 1542247
2013-10-31 18:47:43,013 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,014 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45422, dest: /127.0.0.1:59471, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000000_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8962913433765712905_1437, duration: 2038627
2013-10-31 18:47:43,014 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8962913433765712905_1437 terminating
2013-10-31 18:47:43,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,015 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 from client DFSClient_attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,015 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 is closed by DFSClient_attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,015 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,018 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8962913433765712905_1437 size 30
2013-10-31 18:47:43,065 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000000_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:43,065 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000000_0 0.0%
2013-10-31 18:47:43,577 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_157840219 given task: attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:43,617 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000000_0
2013-10-31 18:47:43,649 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1910409010 given task: attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:43,654 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-231425040 given task: attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:43,851 INFO datanode.DataBlockScanner (DataBlockScanner.java:verifyBlock(462)) - Verification succeeded for blk_-1869663385596486972_1008
2013-10-31 18:47:44,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=null
2013-10-31 18:47:44,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0 dst=null perm=null
2013-10-31 18:47:44,072 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45431, bytes: 1415, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-2476631661436009888_1431, duration: 195264
2013-10-31 18:47:44,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:44,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0/part-00000 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:44,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000000_0 dst=null perm=null
2013-10-31 18:47:44,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:47:44,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=null
2013-10-31 18:47:44,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043/job.split dst=null perm=null
2013-10-31 18:47:44,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49606, bytes: 899, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 512, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-2476631661436009888_1431, duration: 161682
2013-10-31 18:47:44,151 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49324, bytes: 383, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 1024, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-2476631661436009888_1431, duration: 102916
2013-10-31 18:47:44,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:47:44,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt dst=null perm=null
2013-10-31 18:47:44,287 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52237, bytes: 945, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 512, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_695637524992237905_1002, duration: 386604
2013-10-31 18:47:44,288 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49326, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 392164
2013-10-31 18:47:44,955 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000000_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:1086+363
2013-10-31 18:47:44,957 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000000_0 is done.
2013-10-31 18:47:44,957 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000000_0 was -1
2013-10-31 18:47:44,957 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:45,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0 dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:45,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:45,616 INFO mapred.TaskTracker (TaskTracker.java:processKillTaskAction(484)) - Received KillTaskAction for task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:45,617 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(2249)) - About to purge task: attempt_20131031182606197_0043_m_000005_0
2013-10-31 18:47:45,617 INFO mapred.IndexCache (IndexCache.java:removeMap(141)) - Map ID attempt_20131031182606197_0043_m_000005_0 not found in cache
2013-10-31 18:47:45,776 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49328, bytes: 1461, op: HDFS_READ, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_695637524992237905_1002, duration: 391385
2013-10-31 18:47:45,781 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003. blk_-6467763038331022052_1440
2013-10-31 18:47:45,782 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001. blk_-8432574215463755477_1440
2013-10-31 18:47:45,803 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002. blk_5508101355172456519_1440
2013-10-31 18:47:45,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:49612 dest: /127.0.0.1:54365
2013-10-31 18:47:45,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:52244 dest: /127.0.0.1:34578
2013-10-31 18:47:45,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:45439 dest: /127.0.0.1:59471
2013-10-31 18:47:45,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:49334 dest: /127.0.0.1:37740
2013-10-31 18:47:45,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-6467763038331022052_1440 src: /127.0.0.1:45442 dest: /127.0.0.1:59471
2013-10-31 18:47:45,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_-8432574215463755477_1440 src: /127.0.0.1:49618 dest: /127.0.0.1:54365
2013-10-31 18:47:45,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45442, dest: /127.0.0.1:59471, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6467763038331022052_1440, duration: 1565862
2013-10-31 18:47:45,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49618, dest: /127.0.0.1:54365, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8432574215463755477_1440, duration: 320344
2013-10-31 18:47:45,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,811 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52244, dest: /127.0.0.1:34578, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-6467763038331022052_1440, duration: 869820
2013-10-31 18:47:45,811 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,812 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,811 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49334, dest: /127.0.0.1:37740, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 738917
2013-10-31 18:47:45,812 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49612, dest: /127.0.0.1:54365, bytes: 29, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000003_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 2704758
2013-10-31 18:47:45,812 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,812 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,812 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-6467763038331022052_1440 terminating
2013-10-31 18:47:45,813 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 from client DFSClient_attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:45,814 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 is closed by DFSClient_attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:45,815 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,815 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45439, dest: /127.0.0.1:59471, bytes: 41, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000001_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-8432574215463755477_1440, duration: 1686689
2013-10-31 18:47:45,815 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_-8432574215463755477_1440 terminating
2013-10-31 18:47:45,815 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-6467763038331022052_1440 size 29
2013-10-31 18:47:45,817 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:37740 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,817 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 from client DFSClient_attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:45,818 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 is closed by DFSClient_attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:45,818 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_-8432574215463755477_1440 size 41
2013-10-31 18:47:45,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:45440 dest: /127.0.0.1:59471
2013-10-31 18:47:45,830 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:52248 dest: /127.0.0.1:34578
2013-10-31 18:47:45,831 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_5508101355172456519_1440 src: /127.0.0.1:49620 dest: /127.0.0.1:54365
2013-10-31 18:47:45,833 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49620, dest: /127.0.0.1:54365, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_5508101355172456519_1440, duration: 1786459
2013-10-31 18:47:45,833 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,834 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52248, dest: /127.0.0.1:34578, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 2068437
2013-10-31 18:47:45,834 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,834 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,834 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45440, dest: /127.0.0.1:59471, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_20131031182606197_0043_m_000002_0, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_5508101355172456519_1440, duration: 2449682
2013-10-31 18:47:45,834 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_5508101355172456519_1440 terminating
2013-10-31 18:47:45,836 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 from client DFSClient_attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:45,836 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 is closed by DFSClient_attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:45,836 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,838 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_5508101355172456519_1440 size 40
2013-10-31 18:47:45,862 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000003_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,862 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 0.0%
2013-10-31 18:47:45,865 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000001_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,865 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 0.0%
2013-10-31 18:47:45,885 INFO mapred.TaskTracker (TaskTracker.java:commitPending(3543)) - Task attempt_20131031182606197_0043_m_000002_0 is in commit-pending, task state:COMMIT_PENDING
2013-10-31 18:47:45,885 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 0.0%
2013-10-31 18:47:46,621 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000000_0' has completed task_20131031182606197_0043_m_000000 successfully.
2013-10-31 18:47:47,036 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000001_0
2013-10-31 18:47:47,038 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000002_0
2013-10-31 18:47:47,039 INFO mapred.TaskTracker (TaskTracker.java:offerService(1821)) - Received commit task action for attempt_20131031182606197_0043_m_000003_0
2013-10-31 18:47:47,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0 dst=null perm=null
2013-10-31 18:47:47,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0 dst=null perm=null
2013-10-31 18:47:47,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0/part-00003 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0/part-00001 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0 dst=null perm=null
2013-10-31 18:47:47,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=mkdirs src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=hadoop:supergroup:rwxr-xr-x
2013-10-31 18:47:47,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000003_0 dst=null perm=null
2013-10-31 18:47:47,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000001_0 dst=null perm=null
2013-10-31 18:47:47,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=rename src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0/part-00002 dst=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:47,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary/_attempt_20131031182606197_0043_m_000002_0 dst=null perm=null
2013-10-31 18:47:50,042 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:47:50,044 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000001_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:0+362
2013-10-31 18:47:50,045 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000001_0 is done.
2013-10-31 18:47:50,045 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000001_0 was -1
2013-10-31 18:47:50,046 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:50,120 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:47:50,120 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:47:50,123 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000002_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:362+362
2013-10-31 18:47:50,124 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000002_0 is done.
2013-10-31 18:47:50,124 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000003_0 1.0% hdfs://localhost:34237/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/classes/test/data/apache.10.txt:724+362
2013-10-31 18:47:50,124 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000002_0 was -1
2013-10-31 18:47:50,125 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:50,126 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000003_0 is done.
2013-10-31 18:47:50,126 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000003_0 was -1
2013-10-31 18:47:50,126 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:53,041 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000001_0' has completed task_20131031182606197_0043_m_000001 successfully.
2013-10-31 18:47:53,045 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000002_0' has completed task_20131031182606197_0043_m_000002 successfully.
2013-10-31 18:47:53,048 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000003_0' has completed task_20131031182606197_0043_m_000003 successfully.
2013-10-31 18:47:53,050 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(2707)) - Adding task (JOB_CLEANUP) 'attempt_20131031182606197_0043_m_000004_0' to tip task_20131031182606197_0043_m_000004, for tracker 'tracker_10.5.128.102:localhost/127.0.0.1:42022'
2013-10-31 18:47:53,053 INFO mapred.TaskTracker (TaskTracker.java:registerTask(2514)) - LaunchTaskAction (registerTask): attempt_20131031182606197_0043_m_000004_0 task's state:UNASSIGNED
2013-10-31 18:47:53,053 INFO mapred.TaskTracker (TaskTracker.java:run(2451)) - Trying to launch : attempt_20131031182606197_0043_m_000004_0 which needs 1 slots
2013-10-31 18:47:53,053 INFO mapred.TaskTracker (TaskTracker.java:run(2483)) - In TaskLauncher, current free slots : 2 and trying to launch attempt_20131031182606197_0043_m_000004_0 which needs 1 slots
2013-10-31 18:47:53,085 INFO mapred.JvmManager (JvmManager.java:<init>(465)) - In JvmRunner constructed JVM ID: jvm_20131031182606197_0043_m_-1715929147
2013-10-31 18:47:53,086 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(427)) - JVM Runner jvm_20131031182606197_0043_m_-1715929147 spawned.
2013-10-31 18:47:53,088 INFO mapred.TaskController (TaskController.java:writeCommand(222)) - Writing commands to /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/local/1_0/ttprivate/taskTracker/hadoop/jobcache/job_20131031182606197_0043/attempt_20131031182606197_0043_m_000004_0/taskjvm.sh
2013-10-31 18:47:53,955 INFO mapred.TaskTracker (TaskTracker.java:getTask(3443)) - JVM with ID: jvm_20131031182606197_0043_m_-1715929147 given task: attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,485 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000004_0 0.0%
2013-10-31 18:47:54,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary dst=null perm=null
2013-10-31 18:47:54,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=create src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS dst=null perm=hadoop:supergroup:rw-r--r--
2013-10-31 18:47:54,600 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS from client DFSClient_attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,600 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_SUCCESS is closed by DFSClient_attempt_20131031182606197_0043_m_000004_0
2013-10-31 18:47:54,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,613 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_6803672974736063903 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-2476631661436009888 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,614 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:54,615 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,615 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_3823188869741882486 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,615 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:54,615 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:54,616 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_-8952370825653875016 is added to invalidSet of 127.0.0.1:34578
2013-10-31 18:47:54,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/staging/hadoop/.staging/job_20131031182606197_0043 dst=null perm=null
2013-10-31 18:47:55,628 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:34578 to delete blk_-8952370825653875016_1433 blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:55,629 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:59471 to delete blk_-8952370825653875016_1433 blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:56,008 INFO metrics.MetricsSaver (?:checkShouldFlush(?)) - fileExists failed hdfs:/mnt/var/lib/hadoop/metrics/enable_metrics.txt
2013-10-31 18:47:56,019 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,025 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,030 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,035 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,041 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,046 ERROR metrics.MetricsSaver (?:flush(?)) - Failed SaveRecords hdfs:/mnt/var/lib/hadoop/metrics/raw/i-3e21d259_15124_raw.bin This file system object (file:///) does not support access to the request path 'hdfs:/mnt/var/lib/hadoop/metrics' You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf) to obtain a file system supporting your path.
2013-10-31 18:47:56,046 INFO metrics.MetricsSaver (?:flush(?)) - Discard 35 records
2013-10-31 18:47:57,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8952370825653875016_1433 file build/test/data/dfs/data/data6/current/blk_-8952370825653875016 for deletion
2013-10-31 18:47:57,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2476631661436009888_1431 file build/test/data/dfs/data/data6/current/blk_-2476631661436009888 for deletion
2013-10-31 18:47:57,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8952370825653875016_1433 at file build/test/data/dfs/data/data6/current/blk_-8952370825653875016
2013-10-31 18:47:57,067 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3823188869741882486_1432 file build/test/data/dfs/data/data5/current/blk_3823188869741882486 for deletion
2013-10-31 18:47:57,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2476631661436009888_1431 at file build/test/data/dfs/data/data6/current/blk_-2476631661436009888
2013-10-31 18:47:57,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6803672974736063903_1430 file build/test/data/dfs/data/data6/current/blk_6803672974736063903 for deletion
2013-10-31 18:47:57,068 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3823188869741882486_1432 at file build/test/data/dfs/data/data5/current/blk_3823188869741882486
2013-10-31 18:47:57,069 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6803672974736063903_1430 at file build/test/data/dfs/data/data6/current/blk_6803672974736063903
2013-10-31 18:47:57,397 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2814)) - attempt_20131031182606197_0043_m_000004_0 0.0% cleanup
2013-10-31 18:47:57,398 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2916)) - Task attempt_20131031182606197_0043_m_000004_0 is done.
2013-10-31 18:47:57,398 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2917)) - reported output size for attempt_20131031182606197_0043_m_000004_0 was -1
2013-10-31 18:47:57,399 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(2422)) - addFreeSlot : current free slots : 2
2013-10-31 18:47:57,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-8952370825653875016_1433 file build/test/data/dfs/data/data1/current/blk_-8952370825653875016 for deletion
2013-10-31 18:47:57,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_-2476631661436009888_1431 file build/test/data/dfs/data/data1/current/blk_-2476631661436009888 for deletion
2013-10-31 18:47:57,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-8952370825653875016_1433 at file build/test/data/dfs/data/data1/current/blk_-8952370825653875016
2013-10-31 18:47:57,464 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_3823188869741882486_1432 file build/test/data/dfs/data/data2/current/blk_3823188869741882486 for deletion
2013-10-31 18:47:57,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_-2476631661436009888_1431 at file build/test/data/dfs/data/data1/current/blk_-2476631661436009888
2013-10-31 18:47:57,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:deleteAsync(143)) - Scheduling block blk_6803672974736063903_1430 file build/test/data/dfs/data/data2/current/blk_6803672974736063903 for deletion
2013-10-31 18:47:57,465 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_3823188869741882486_1432 at file build/test/data/dfs/data/data2/current/blk_3823188869741882486
2013-10-31 18:47:57,466 INFO datanode.DataNode (FSDatasetAsyncDiskService.java:run(189)) - Deleted block blk_6803672974736063903_1430 at file build/test/data/dfs/data/data2/current/blk_6803672974736063903
2013-10-31 18:47:58,629 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:37740 to delete blk_-8952370825653875016_1433 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:58,629 INFO hdfs.StateChange (FSNamesystem.java:invalidateWorkForOneNode(3207)) - BLOCK* ask 127.0.0.1:54365 to delete blk_3823188869741882486_1432 blk_-2476631661436009888_1431 blk_6803672974736063903_1430
2013-10-31 18:47:59,059 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2857)) - Task 'attempt_20131031182606197_0043_m_000004_0' has completed task_20131031182606197_0043_m_000004 successfully.
2013-10-31 18:47:59,060 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(3035)) - Job job_20131031182606197_0043 has completed successfully.
2013-10-31 18:47:59,060 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3778)) - jobId=job_20131031182606197_0043,submitTime=1383245252661,launchTime=1383245252776,firstMapTaskLaunchTime=1383245260613,firstJobSetupTaskLaunchTime=1383245254594,firstJobCleanupTaskLaunchTime=1383245273050,finishTime=1383245279060,numMaps=4,numSlotsPerMap=1,numReduces=0,numSlotsPerReduce=1,user=hadoop,queue=default,status=SUCCEEDED,mapSlotSeconds=39,reduceSlotsSeconds=0,clusterMapCapacity=8,clusterReduceCapacity=8,jobName=[E00F2344117143A5B429E5EE528AF580/3B12F52DDD1C48908457498CADDDFFE9] test/(1/1) ...ldedpipesplatform/nogroup
2013-10-31 18:47:59,065 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1746)) - BLOCK* NameSystem.allocateBlock: /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890. blk_9068118107613675848_1441
2013-10-31 18:47:59,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:52254 dest: /127.0.0.1:34578
2013-10-31 18:47:59,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:49626 dest: /127.0.0.1:54365
2013-10-31 18:47:59,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(250)) - Receiving block blk_9068118107613675848_1441 src: /127.0.0.1:45453 dest: /127.0.0.1:59471
2013-10-31 18:47:59,081 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:45453, dest: /127.0.0.1:59471, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_9068118107613675848_1441, duration: 6136296
2013-10-31 18:47:59,082 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 0 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,082 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:49626, dest: /127.0.0.1:54365, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_9068118107613675848_1441, duration: 4059705
2013-10-31 18:47:59,083 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 1 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,083 INFO DataNode.clienttrace (BlockReceiver.java:run(862)) - src: /127.0.0.1:52254, dest: /127.0.0.1:34578, bytes: 22671, op: HDFS_WRITE, cliID: DFSClient_-347020941, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_9068118107613675848_1441, duration: 5097593
2013-10-31 18:47:59,084 INFO datanode.DataNode (BlockReceiver.java:run(909)) - PacketResponder 2 for block blk_9068118107613675848_1441 terminating
2013-10-31 18:47:59,086 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:34578 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,087 INFO hdfs.StateChange (FSNamesystem.java:finalizeINodeFileUnderConstruction(2217)) - Removing lease on file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 from client DFSClient_-347020941
2013-10-31 18:47:59,087 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1705)) - DIR* NameSystem.completeFile: file /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_logs/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 is closed by DFSClient_-347020941
2013-10-31 18:47:59,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:59471 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,088 INFO hdfs.StateChange (FSNamesystem.java:addStoredBlock(3686)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:54365 is added to blk_9068118107613675848_1441 size 22671
2013-10-31 18:47:59,095 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0043_1383245252661_hadoop_%5BE00F2344117143A5B429E5EE528AF580%2F3B12F52DDD1C4890 to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:59,096 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0043_m_000003_0'
2013-10-31 18:47:59,096 INFO mapred.JobTracker (JobTracker.java:removeTaskEntry(2741)) - Removing task 'attempt_20131031182606197_0043_m_000004_0'
2013-10-31 18:47:59,098 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:59471
2013-10-31 18:47:59,104 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:37740
2013-10-31 18:47:59,104 INFO hdfs.StateChange (FSNamesystem.java:addToInvalidates(1799)) - BLOCK* NameSystem.addToInvalidates: blk_862287065973210454 is added to invalidSet of 127.0.0.1:54365
2013-10-31 18:47:59,106 INFO mapred.JobHistory (JobHistory.java:run(305)) - Moving file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/job_20131031182606197_0043_conf.xml to file:/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/log/history/done/version-1/localhost_1383243966265_/2013/10/31/000000
2013-10-31 18:47:59,109 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/_temporary
2013-10-31 18:47:59,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=delete src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/tmp/mapred/system/job_20131031182606197_0043 dst=null perm=null
2013-10-31 18:47:59,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=null
2013-10-31 18:47:59,166 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:47:59,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 dst=null perm=null
2013-10-31 18:47:59,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 dst=null perm=null
2013-10-31 18:47:59,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 dst=null perm=null
2013-10-31 18:47:59,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 dst=null perm=null
2013-10-31 18:47:59,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 dst=null perm=null
2013-10-31 18:47:59,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49346, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 291097
2013-10-31 18:47:59,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 dst=null perm=null
2013-10-31 18:47:59,179 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49347, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 337566
2013-10-31 18:47:59,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 dst=null perm=null
2013-10-31 18:47:59,182 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52260, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 260387
2013-10-31 18:47:59,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 dst=null perm=null
2013-10-31 18:47:59,185 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49632, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 266893
2013-10-31 18:47:59,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=null
2013-10-31 18:47:59,202 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(199)) - Total input paths to process : 4
2013-10-31 18:47:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 dst=null perm=null
2013-10-31 18:47:59,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 dst=null perm=null
2013-10-31 18:47:59,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 dst=null perm=null
2013-10-31 18:47:59,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 dst=null perm=null
2013-10-31 18:47:59,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 dst=null perm=null
2013-10-31 18:47:59,211 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52262, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_-8962913433765712905_1437, duration: 253654
2013-10-31 18:47:59,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 dst=null perm=null
2013-10-31 18:47:59,214 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49351, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8432574215463755477_1440, duration: 252321
2013-10-31 18:47:59,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 dst=null perm=null
2013-10-31 18:47:59,217 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52264, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 253306
2013-10-31 18:47:59,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 dst=null perm=null
2013-10-31 18:47:59,221 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:59471, dest: /127.0.0.1:45462, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-955759156-10.5.128.102-59471-1383243965559, blockid: blk_-6467763038331022052_1440, duration: 259338
2013-10-31 18:47:59,221 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output//hadoop/fieldedpipesplatform/nogroup
2013-10-31 18:47:59,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=listStatus src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup dst=null perm=null
2013-10-31 18:47:59,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00000 dst=null perm=null
2013-10-31 18:47:59,229 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:37740, dest: /127.0.0.1:49354, bytes: 34, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-1799801127-10.5.128.102-37740-1383243966037, blockid: blk_-8962913433765712905_1437, duration: 263431
2013-10-31 18:47:59,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00001 dst=null perm=null
2013-10-31 18:47:59,233 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49638, bytes: 45, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-8432574215463755477_1440, duration: 263778
2013-10-31 18:47:59,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00002 dst=null perm=null
2013-10-31 18:47:59,238 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:34578, dest: /127.0.0.1:52268, bytes: 44, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-11064708-10.5.128.102-34578-1383243962924, blockid: blk_5508101355172456519_1440, duration: 284093
2013-10-31 18:47:59,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(166)) - ugi=hadoop ip=/127.0.0.1 cmd=open src=/home/hadoop/cascading.compatibility/amazon-emr-2.4.2/build/test/output/hadoop/fieldedpipesplatform/nogroup/part-00003 dst=null perm=null
2013-10-31 18:47:59,242 INFO DataNode.clienttrace (BlockSender.java:sendBlock(458)) - src: /127.0.0.1:54365, dest: /127.0.0.1:49640, bytes: 33, op: HDFS_READ, cliID: DFSClient_-1596270109, offset: 0, srvID: DS-316833290-10.5.128.102-54365-1383243963561, blockid: blk_-6467763038331022052_1440, duration: 258787